Feeds

Benchmark battles – now Linux beats NT

A 'real life scenario' test by c't mag does a good job of putting things in context

  • alert
  • submit to reddit

The essential guide to IT transformation

In the wake of the latest in the round of NT versus Linux face-offs German magazine c't has published the results of its own tests of the two operating systems. The c't tests, conducted by Jurgen Schmidt, were intended to assess the two rivals in 'real life' situations of the sort Linux is supposed to be good at. Linux does a lot better than it has in the 'clash of armour' benchmarks we've seen so far, and Schmidt makes a number of eminently valid and sensible observations concerning the real operation of Web servers. (Full c't report) The tests pitted NT 4.0 and IIS against SuSE Linux 6.1 and Apache on a quad 450MHz Xeon Siemens server with two gigs RAM, twin EtherPro 100 boards and a RAID system. One of the first 'real life' differences between the c't and Mindcraft tests was the use of RAID-5 rather than RAID-0. Mindcraft's use of the latter was aimed at performance, while c't went for a more realistic performance/stability compromise. Schmidt also comments on the nature of the Mindcraft test: "Unlike for the Mindcraft test, which required the server to produce its pages through four 100-MBit interfaces we decided on a more realistic scenario. How many web servers actually serve four of these network interfaces? The majority of web servers make do with a 10-MBit interface and even in intranet one 100-MBit board should be sufficient. This was the configuration we chose for our tests. To get an impression of maximum load behaviour anyway, we made the server prove it can handle two Fast Ethernet connections." For serving a static HTML page of 4-8k, the two came out roughly even at 4k, with Linux slightly ahead at 8k. Schmidt notes that both operating systems didn't benefit to any great extent from use of multiple CPUs, although the Linux installation was running kernel 2.2.9, which is better at SMP than 2.2.5. Linux did however performs substantially better in random requests of 1,000,000 4k files. With 512 requesters NT managed to answer 30 per second, and Linux 274. In another test using a CGI Perl script, Linux delivered twice as many pages as NT on a single CPU, and 2.5 times as many with four CPUs. This isn't entirely surprising, as IIS' support for Perl isn't great. NT did however shine when using multiple network boards, and Schmidt comments: "Linux's comparatively bad results when tested with two network boards show that Mindcraft's results are quite realistic. NT and IIS are clearly superior to their free competitors if you stick to their rules." In summary, he feels that "additional CPUs for plain web server operation with static HTML pages are a waste. Even with two Fast Ethernet lines there's only a moderate less than twenty percent increase." The server wasn't needing to work to its full capacity, and the tests were simulating conditions tougher than you'd expect in most real life scenarios. "In SMP mode, Linux still exhibited clear weaknesses. Kernel developers, too, admit freely that scalability problems still exist in SMP mode if the major part of the load comes through in kernel mode. However, if user mode tasks are involved as well, as is the case with CGI scripts, Linux can benefit from additional processors, too. These SMP problems are currently the target of massive developing efforts." In the most relevant, practical areas, Linux and Apache "are already ahead by at least a nose," while if the pages don't come directly from main system memory, they're more clearly ahead. c't was also impressed by the level of support it got from the Linux community. Microsoft was slow to respond to requests for information, while "Emails to the respective [Linux] mailing lists even resulted in special kernel patches which significantly increased performance. We have, on the other hand, never heard of an NT support contract supplying NT kernels specially designed for customer problems." A very sensible report, and well worth reading in detail. ®

Build a business case: developing custom apps

More from The Register

next story
Assange™: Hey world, I'M STILL HERE, ignore that Snowden guy
Press conference: ME ME ME ME ME ME ME (cont'd pg 94)
Premier League wants to PURGE ALL FOOTIE GIFs from social media
Not paying Murdoch? You're gonna get a right LEGALLING - thanks to automated software
Online tat bazaar eBay coughs to YET ANOTHER outage
Web-based flea market struck dumb by size and scale of fail
Amazon takes swipe at PayPal, Square with card reader for mobes
Etailer plans to undercut rivals with low transaction fee offer
Caught red-handed: UK cops, PCSOs, specials behaving badly… on social media
No Mr Fuzz, don't ask a crime victim to be your pal on Facebook
US regulators OK sale of IBM's x86 server biz to Lenovo
Now all that remains is for gov't offices to ban the boxes
XBOX One will learn to play media from USB and DLNA sources
Hang on? Aren't those file formats you hardly ever see outside torrents?
Class war! Wikipedia's workers revolt again
Bourgeois paper-shufflers have 'suspended democracy', sniff unpaid proles
prev story

Whitepapers

Endpoint data privacy in the cloud is easier than you think
Innovations in encryption and storage resolve issues of data privacy and key requirements for companies to look for in a solution.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Top 8 considerations to enable and simplify mobility
In this whitepaper learn how to successfully add mobile capabilities simply and cost effectively.
Solving today's distributed Big Data backup challenges
Enable IT efficiency and allow a firm to access and reuse corporate information for competitive advantage, ultimately changing business outcomes.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.