Feeds

Google mystery server runs 13% of active websites

And only Google runs its mystery server

Internet Security Threat Report 2014

The Google Web Server - custom-built server software used only by Google - now runs nearly 13 per cent of all active web sites, according to the latest survey data from the web-server-tracking UK research outfit Netcraft.

Netcraft data has the Google Web Server (GWS) running nearly 11 million active sites - i.e., sites with recently updated content. This total includes not only sites run solely by Google, but also sites the company operates on behalf of third parties via services like Blogger, Google Docs, and Google App Engine.

Apache is still the most prevalent web server, with nearly 44m active sites, and Microsoft servers are second with nearly 14m. But the Google Web Server tops all others and trails Microsoft by a mere 3m sites - despite being unavailable for use outside what Mountain View has called "the Google Network," a worldwide proprietary infrastructure that amounts to a private internet.

Apache and Microsoft servers are available to anyone.

Google does not discuss GWS. In the past, some reports have indicated that it's based on Apache. But in a 2007 web post, über Googler Matt Cutts indicated otherwise. "That's not correct," he wrote. "I believe GWS is a custom web server, not a modified version of Apache."

Google did not respond to our request for comment on the Google Web Server. And on previous occasions, it has given other news outlets a mere one-line description. "The Google Web server is a custom-built server that runs on Linux."

When Netcraft looks at all websites - active or not - the Google Web Server accounts for 7 per cent, or 14.5m. Apache handles around 111m (54 per cent), Microsoft nearly 49m (24 per cent).

Google's private internet - which spans nearly 40 data centers across the globe - is built atop countless custom-built and proprietary tools, including a top-secret distributed file system dubbed GFS; the distributed number-crunching platform known as MapReduce; and a new platform known as Spanner that's designed to automatically move and replicate loads between the company's mega data centers when traffic and hardware issues arise.

Google also builds its own data centers and its own servers, with design help from Intel and, according to one source speaking with The Reg, a breed of Intel chip guaranteed to withstand higher temperatures. Reports even indicate that Mountain View builds its own routers.

What's more, Google has purchased its own dark fiber to move data between its data centers, and the company is building an underwater comms cable to move data across the Pacific.

According to the latest report from Arbor Networks, Google now accounts for 6 per cent of all internet traffic. ®

Secure remote control for conventional and virtual desktops

More from The Register

next story
Netscape Navigator - the browser that started it all - turns 20
It was 20 years ago today, Marc Andreeesen taught the band to play
Sway: Microsoft's new Office app doesn't have an Undo function
Content aggregation, meet the workplace ... oh
Sign off my IT project or I’ll PHONE your MUM
Honestly, it’s a piece of piss
Do Moan! MONSTER 6-day EMAIL OUTAGE hits Domain Monster
Customers freaked out by frightful service
Return of the Jedi – Apache reclaims web server crown
.london, .hamburg and .公司 - that's .com in Chinese - storm the web server charts
NetWare sales revive in China thanks to that man Snowden
If it ain't Microsoft, it's in fashion behind the Great Firewall
prev story

Whitepapers

Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Why cloud backup?
Combining the latest advancements in disk-based backup with secure, integrated, cloud technologies offer organizations fast and assured recovery of their critical enterprise data.
Win a year’s supply of chocolate
There is no techie angle to this competition so we're not going to pretend there is, but everyone loves chocolate so who cares.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Intelligent flash storage arrays
Tegile Intelligent Storage Arrays with IntelliFlash helps IT boost storage utilization and effciency while delivering unmatched storage savings and performance.