Feeds

Test lab ‘proves’ both cases in Novell vs. MS directory wars

Utah outfit retained by both companies justifies respective, contradictory claims

  • alert
  • submit to reddit

Boost IT visibility and business value

Microsoft has made another attempt at beating Novell in the directory game, but has tripped itself up again in the process. This time Microsoft chose a Utah testing house called KeyLabs that Novell had used in the past, and asked it to carry out some tests so that Microsoft could have third party verification. Novell corporate strategist Brad Anderson told The Register that he thought it probable that Microsoft had found some non-real-world cases in its labs where NDS eDirectory (as NDS 8 is now called) could be beaten by Active Directory, and then asked KeyLabs to verify the tests independently. Novell was incensed, and also commissioned KeyLabs to run some real-world tests that, perhaps not surprisingly, show NDS performance in a very different light. While Microsoft referred to KeyLabs as a "Novell Authorised Testing Site" in its release, Novell countered that KeyLabs was a "registered Microsoft Certified Solutions Partner". You get the picture. Credit is due to KeyLabs for mentioning in its report commissioned by Microsoft that SSL security was switched off for its tests, and that IIS was not installed (increasing performance of course) - something that Microsoft forgot to mention in its release. Microsoft made a big issue of 96 scenarios being tried, but they were hardly realistic ones. The Novell tests, with more realistic configurations, included security and some searches not attempted by Microsoft for reasons that will become clear in a moment. An important issue not mentioned in the tests is that Active Directory only works with Windows 2000 (and not even NT), whereas NDS is happy with Solaris, NetWare, NT, Windows 2000 (and Tru64 this summer). There is something of a problem with Linux and NDS, since client connectivity with SAMBA does not yet support NDS authentication, but we digress. With multi-faceted, simultaneous searches, KeyLabs found NDS outperformed Active Directory by 250 percent on average. But worse was to come. Microsoft did not do any LDAP "contains" searches (completing a search across a sub-tree after a few characters are typed) when it defined the tests that KeyLabs was to run. Microsoft evidently knew that if more than one client workstation were used, Active Directory would not return any results at all: so much for Windows 2000's reliability. Where Active Directory was able to produce results with one workstation, NDS was 1250 times faster (yes, that is "times", and not "per cent"). Another example of Active Directory's inability to perform was seen in a mixed search test, where NDS returned results in 100 percent of cases, but AD failed to return results in 715 out of 6,000 cases - so that one in eight searches with Active Directory failed. Another scalability test showed that in a scenario with 10,000 searches - 100 clients performing 100 searches - NDS produced 250 results/second, but Active Directory failed to produce a single result after 60 seconds. Two different and important issues arise from these tests. The first is concerned with the ethical problems that are posed when a test organisation appears to bend both ways in endorsing test results from clients with horns locked. However scrupulously they perform their work - and there is no suggestion that KeyLabs did otherwise - such organisations are effectively muzzled by their clients from making any useful comments. Instead, we find the absurd situation of Matt Mace, director of quality at KeyLabs, being quoted by Microsoft as saying: "In each of the 96 LDAP-based tests we performed, Active Directory running on Windows 2000 Server exceeded the performance on Novell's NDS Version 8 running NetWare 5.1". But just three days later, he was quoted by Novell as saying that "In each of the LDAP-based tests we performed, using simultaneous different search types, Novell's NDS exceeded the performance of Active Directory running on the Windows 2000 Server." Mace had not returned our call inviting comment at press time. It seems that benchmark testing, which has been used in the industry since the days when big iron was compared, has not resolved the problems that were manifest nearly forty years ago. The other issue concerns the truthfulness of marketing messages. Yes, it is marketing, and of course there will be hype, but facts are supposed to be facts. Novell has been a little too quiet about its multiprocessing capability, promised for the next iteration of NetWare, and how this might affect present performance. Microsoft has been making excessive claims about the performance, scalability and reliability of Windows 2000. Yesterday, CIO Jim Yost of the Ford Motor Co told the Windows 2000 meeting in San Francisco that "Windows 2000 was chosen [by Ford] for both its scalability and reliability". He's not the only one who needs to dig deeper than the hype. ®

The Power of One Brief: Top reasons to choose HP BladeSystem

More from The Register

next story
Stick a 4K in them: Super high-res TVs are DONE
4,000 pixels is niche now... Don't say we didn't warn you
BBC goes offline in MASSIVE COCKUP: Stephen Fry partly muzzled
Auntie tight-lipped as major outage rolls on
Philip K Dick 'Nazi alternate reality' story to be made into TV series
Amazon Studios, Ridley Scott firm to produce The Man in the High Castle
iPad? More like iFAD: We reveal why Apple fell into IBM's arms
But never fear fanbois, you're still lapping up iPhones, Macs
Bose says today is F*** With Dre Day: Beats sued in patent battle
Music gear giant seeks some of that sweet, sweet Apple pie
There's NOTHING on TV in Europe – American video DOMINATES
Even France's mega subsidies don't stop US content onslaught
You! Pirate! Stop pirating, or we shall admonish you politely. Repeatedly, if necessary
And we shall go about telling people you smell. No, not really
Too many IT conferences to cover? MICROSOFT to the RESCUE!
Yet more word of cuts emerges from Redmond
Joe Average isn't worth $10 a year to Mark Zuckerberg
The Social Network deflates the PC resurgence with mobile-only usage prediction
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
Application security programs and practises
Follow a few strategies and your organization can gain the full benefits of open source and the cloud without compromising the security of your applications.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Securing Web Applications Made Simple and Scalable
Learn how automated security testing can provide a simple and scalable way to protect your web applications.