Benchmark battles – now Linux beats NT

A 'real life scenario' test by c't mag does a good job of putting things in context

  • alert
  • submit to reddit

Boost IT visibility and business value

In the wake of the latest in the round of NT versus Linux face-offs German magazine c't has published the results of its own tests of the two operating systems. The c't tests, conducted by Jurgen Schmidt, were intended to assess the two rivals in 'real life' situations of the sort Linux is supposed to be good at. Linux does a lot better than it has in the 'clash of armour' benchmarks we've seen so far, and Schmidt makes a number of eminently valid and sensible observations concerning the real operation of Web servers. (Full c't report) The tests pitted NT 4.0 and IIS against SuSE Linux 6.1 and Apache on a quad 450MHz Xeon Siemens server with two gigs RAM, twin EtherPro 100 boards and a RAID system. One of the first 'real life' differences between the c't and Mindcraft tests was the use of RAID-5 rather than RAID-0. Mindcraft's use of the latter was aimed at performance, while c't went for a more realistic performance/stability compromise. Schmidt also comments on the nature of the Mindcraft test: "Unlike for the Mindcraft test, which required the server to produce its pages through four 100-MBit interfaces we decided on a more realistic scenario. How many web servers actually serve four of these network interfaces? The majority of web servers make do with a 10-MBit interface and even in intranet one 100-MBit board should be sufficient. This was the configuration we chose for our tests. To get an impression of maximum load behaviour anyway, we made the server prove it can handle two Fast Ethernet connections." For serving a static HTML page of 4-8k, the two came out roughly even at 4k, with Linux slightly ahead at 8k. Schmidt notes that both operating systems didn't benefit to any great extent from use of multiple CPUs, although the Linux installation was running kernel 2.2.9, which is better at SMP than 2.2.5. Linux did however performs substantially better in random requests of 1,000,000 4k files. With 512 requesters NT managed to answer 30 per second, and Linux 274. In another test using a CGI Perl script, Linux delivered twice as many pages as NT on a single CPU, and 2.5 times as many with four CPUs. This isn't entirely surprising, as IIS' support for Perl isn't great. NT did however shine when using multiple network boards, and Schmidt comments: "Linux's comparatively bad results when tested with two network boards show that Mindcraft's results are quite realistic. NT and IIS are clearly superior to their free competitors if you stick to their rules." In summary, he feels that "additional CPUs for plain web server operation with static HTML pages are a waste. Even with two Fast Ethernet lines there's only a moderate less than twenty percent increase." The server wasn't needing to work to its full capacity, and the tests were simulating conditions tougher than you'd expect in most real life scenarios. "In SMP mode, Linux still exhibited clear weaknesses. Kernel developers, too, admit freely that scalability problems still exist in SMP mode if the major part of the load comes through in kernel mode. However, if user mode tasks are involved as well, as is the case with CGI scripts, Linux can benefit from additional processors, too. These SMP problems are currently the target of massive developing efforts." In the most relevant, practical areas, Linux and Apache "are already ahead by at least a nose," while if the pages don't come directly from main system memory, they're more clearly ahead. c't was also impressed by the level of support it got from the Linux community. Microsoft was slow to respond to requests for information, while "Emails to the respective [Linux] mailing lists even resulted in special kernel patches which significantly increased performance. We have, on the other hand, never heard of an NT support contract supplying NT kernels specially designed for customer problems." A very sensible report, and well worth reading in detail. ®

The Power of One Brief: Top reasons to choose HP BladeSystem

More from The Register

next story
Stick a 4K in them: Super high-res TVs are DONE
4,000 pixels is niche now... Don't say we didn't warn you
BBC goes offline in MASSIVE COCKUP: Stephen Fry partly muzzled
Auntie tight-lipped as major outage rolls on
Philip K Dick 'Nazi alternate reality' story to be made into TV series
Amazon Studios, Ridley Scott firm to produce The Man in the High Castle
iPad? More like iFAD: We reveal why Apple fell into IBM's arms
But never fear fanbois, you're still lapping up iPhones, Macs
Amazon Reveals One Weird Trick: A Loss On Almost $20bn In Sales
Investors really hate it: Share price plunge as growth SLOWS in key AWS division
Bose says today is F*** With Dre Day: Beats sued in patent battle
Music gear giant seeks some of that sweet, sweet Apple pie
There's NOTHING on TV in Europe – American video DOMINATES
Even France's mega subsidies don't stop US content onslaught
You! Pirate! Stop pirating, or we shall admonish you politely. Repeatedly, if necessary
And we shall go about telling people you smell. No, not really
Too many IT conferences to cover? MICROSOFT to the RESCUE!
Yet more word of cuts emerges from Redmond
prev story


Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
Application security programs and practises
Follow a few strategies and your organization can gain the full benefits of open source and the cloud without compromising the security of your applications.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Securing Web Applications Made Simple and Scalable
Learn how automated security testing can provide a simple and scalable way to protect your web applications.