Feeds

FAST claims world's biggest search engine

But size isn't everything

  • alert
  • submit to reddit

Internet Security Threat Report 2014

The Norwegian boffins behind a new search engine reckon it will be able to catalogue the entire Internet by next year. They claim alltheweb.com will be capable of searching "all the Web all the time" thanks to the Dell technology powering the service. It took scientists at Fast Search & Transfer (FAST) ten years to develop alltheweb.com which they've already described as the "world's biggest search engine". With more than 200 million unique URLs in its database, alltheweb.com is almost twice the size of search engine reseller Inktomi and three to four times bigger than several popular search engines. FAST intends to sell the technology to portals and other search services in much the same way as rival Inktomi. And it claims that the technology is so good, it can search its entire database in less than one second. So The Register decided to put it to the test. Amazingly, it took just 0.6830 seconds to find 154,446 documents relating to The Register. Unfortunately, none of them pointed to the home page -- just individual pages from as far back as 1997. If this is the kind of response users get it could turn searching the Web into a lifetime's quest. Size, it seems, isn't everything. ®

Providing a secure and efficient Helpdesk

More from The Register

next story
Facebook, Apple: LADIES! Why not FREEZE your EGGS? It's on the company!
No biological clockwatching when you work in Silicon Valley
Doctor Who's Flatline: Cool monsters, yes, but utterly limp subplots
We know what the Doctor does, stop going on about it already
'Cowardly, venomous trolls' threatened with TWO-YEAR sentences for menacing posts
UK government: 'Taking a stand against a baying cyber-mob'
Happiness economics is bollocks. Oh, UK.gov just adopted it? Er ...
Opportunity doesn't knock; it costs us instead
Arab States make play for greater government control of the internet
Nerds told to get lost in last-minute power grab bid at UN meeting
Zippy one-liners, broken promises: Doctor Who on the Orient Express
Series finally hits stride, but Clara's U-turn is baffling
Don't bother telling people if you lose their data, say Euro bods
You read that right – with the proviso that it's encrypted
Apple SILENCES Bose, YANKS headphones from stores
The, er, Beats go on after noise-cancelling spat
prev story

Whitepapers

Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Why cloud backup?
Combining the latest advancements in disk-based backup with secure, integrated, cloud technologies offer organizations fast and assured recovery of their critical enterprise data.
Win a year’s supply of chocolate
There is no techie angle to this competition so we're not going to pretend there is, but everyone loves chocolate so who cares.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Intelligent flash storage arrays
Tegile Intelligent Storage Arrays with IntelliFlash helps IT boost storage utilization and effciency while delivering unmatched storage savings and performance.