Feeds

My spam-filled search index is bigger than yours!

NCSA study backfires

Top 5 reasons to deploy VMware with Tegile

Last week Yahoo! claimed it had sailed past Google by indexing 20 billion web pages.

Because as much as a third of the wild wild web consists of artificially-generated pages of spam designed to promote commercial web sites, this isn't much to boast about. Many of the fake pages are 'splogs', or spam blogs, or phoney catalogs, or simply pages of dictionary words. You can meet one of the perps here, in our story Interview with a link spammer.

And because few users have the patience to find the gem returned at position #12,711 in the search results, then the size of an index is meaningless.

More is never a substitute for better.

Unofficial Google spokesperson John Battelle has disputed the claim, and now the supercomputer center NCSA has poured cold water on the boast, too.

In a sample comparison, three researchers University of Illinois at Urbana-Champaign found that Google returned more search results than Yahoo! They conclude,

"It is the opinion of this study that Yahoo!'s claim to have a web index of over twice as many documents as Google's index is suspicious. Unless a large number of the documents Yahoo! has indexed are not yet available to its search engine, we find it puzzling that Yahoo!'s search engine consistently returned fewer results than Google."

A bold claim, for sure. There's a problem, however - NCSA's results are a little too incredible.

As Seth Finkelstein points out on his weblog, the NCSA researchers fed random dictionary words into both search engines - and not surprisingly, the results reflect pages containing random dictionary words.

"By sampling random words, they biased the samples to files of large word lists! And this effect applies, to a great or lesser extent, to every sample.

Here's an example. For the spam friendly gibberish words "carbolization clambers" Google returned 7 pages, all from a dictionary, and Yahoo! returned none. For the words " alkaloid's observance", Google returns 30 pages and Yahoo none.

In other words, the methodology is geared not to measure who has the most useful documents, but who has the most spam. To be more precise, in these examples, Google returns a number of copies of a dictionary file. It's a different frequency of noise.

"Just to show the problem, imagine that Google had returned results of three dictionary files, and Yahoo one dictionary file," explains Finkelstein. "Do this *10,000* times, and you get Google returning 30,000 results, and Yahoo! returning 10,000 results. So, wow, Google has 3x the size! But, in fact, it's just the same little quirk being counted 10,000 times over!"

The intrepid NCSA researchers appear to be blissfully unaware of that they've marched into a swamp.

"We feel that small, randomly selected search queries gives us the best chance to locate some of the most obscure web documents," they insist. Nevertheless, they plough bravely on.

"By counting the presence of these obscure documents in either search engine, we can measure the comprehensiveness of each search engine to determine the relative size of each search engine's index," they maintain.

Oh, dear.

The Argentian writer Borges described the Falklands War as "two bald men fighting over a comb", and it's an apt description for the spectacle of the search engines, and their rival supporters, duking it out to boast who's has collected the most garbage. ®

Intelligent flash storage arrays

More from The Register

next story
BIG FAT Lies: Porky Pies about obesity
What really shortens lives? Reading this sort of crap in the papers
Assange™ slumps back on Ecuador's sofa after detention appeal binned
Swedish court rules there's 'great risk' WikiLeaker will dodge prosecution
You think the CLOUD's insecure? It's BETTER than UK.GOV's DATA CENTRES
We don't even know where some of them ARE – Maude
NSA mass spying reform KILLED by US Senators
Democrats needed just TWO more votes to keep alive bill reining in some surveillance
prev story

Whitepapers

Choosing cloud Backup services
Demystify how you can address your data protection needs in your small- to medium-sized business and select the best online backup service to meet your needs.
Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Seattle children’s accelerates Citrix login times by 500% with cross-tier insight
Seattle Children’s is a leading research hospital with a large and growing Citrix XenDesktop deployment. See how they used ExtraHop to accelerate launch times.
5 critical considerations for enterprise cloud backup
Key considerations when evaluating cloud backup solutions to ensure adequate protection security and availability of enterprise data.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?