Feeds

Google mystery server runs 13% of active websites

And only Google runs its mystery server

High performance access to file storage

The Google Web Server - custom-built server software used only by Google - now runs nearly 13 per cent of all active web sites, according to the latest survey data from the web-server-tracking UK research outfit Netcraft.

Netcraft data has the Google Web Server (GWS) running nearly 11 million active sites - i.e., sites with recently updated content. This total includes not only sites run solely by Google, but also sites the company operates on behalf of third parties via services like Blogger, Google Docs, and Google App Engine.

Apache is still the most prevalent web server, with nearly 44m active sites, and Microsoft servers are second with nearly 14m. But the Google Web Server tops all others and trails Microsoft by a mere 3m sites - despite being unavailable for use outside what Mountain View has called "the Google Network," a worldwide proprietary infrastructure that amounts to a private internet.

Apache and Microsoft servers are available to anyone.

Google does not discuss GWS. In the past, some reports have indicated that it's based on Apache. But in a 2007 web post, über Googler Matt Cutts indicated otherwise. "That's not correct," he wrote. "I believe GWS is a custom web server, not a modified version of Apache."

Google did not respond to our request for comment on the Google Web Server. And on previous occasions, it has given other news outlets a mere one-line description. "The Google Web server is a custom-built server that runs on Linux."

When Netcraft looks at all websites - active or not - the Google Web Server accounts for 7 per cent, or 14.5m. Apache handles around 111m (54 per cent), Microsoft nearly 49m (24 per cent).

Google's private internet - which spans nearly 40 data centers across the globe - is built atop countless custom-built and proprietary tools, including a top-secret distributed file system dubbed GFS; the distributed number-crunching platform known as MapReduce; and a new platform known as Spanner that's designed to automatically move and replicate loads between the company's mega data centers when traffic and hardware issues arise.

Google also builds its own data centers and its own servers, with design help from Intel and, according to one source speaking with The Reg, a breed of Intel chip guaranteed to withstand higher temperatures. Reports even indicate that Mountain View builds its own routers.

What's more, Google has purchased its own dark fiber to move data between its data centers, and the company is building an underwater comms cable to move data across the Pacific.

According to the latest report from Arbor Networks, Google now accounts for 6 per cent of all internet traffic. ®

High performance access to file storage

More from The Register

next story
Android engineer: We DIDN'T copy Apple OR follow Samsung's orders
Veep testifies for Samsung during Apple patent trial
This time it's 'Personal': new Office 365 sub covers just two devices
Redmond also brings Office into Google's back yard
Windows 8.1, which you probably haven't upgraded to yet, ALREADY OBSOLETE
Pre-Update versions of new Windows version will no longer support patches
Microsoft lobs pre-release Windows Phone 8.1 at devs who dare
App makers can load it before anyone else, but if they do they're stuck with it
Batten down the hatches, Ubuntu 14.04 LTS due in TWO DAYS
Admins dab straining server brows in advance of Trusty Tahr's long-term support landing
Half of Twitter's 'active users' are SILENT STALKERS
Nearly 50% have NEVER tweeted a word
Windows XP still has 27 per cent market share on its deathbed
Windows 7 making some gains on XP Death Day
Internet-of-stuff startup dumps NoSQL for ... SQL?
NoSQL taste great at first but lacks proper nutrients, says startup cloud whiz
Microsoft TIER SMEAR changes app prices whether devs ask or not
Some go up, some go down, Redmond goes silent
prev story

Whitepapers

Securing web applications made simple and scalable
In this whitepaper learn how automated security testing can provide a simple and scalable way to protect your web applications.
Five 3D headsets to be won!
We were so impressed by the Durovis Dive headset we’ve asked the company to give some away to Reg readers.
HP ArcSight ESM solution helps Finansbank
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Mobile application security study
Download this report to see the alarming realities regarding the sheer number of applications vulnerable to attack, as well as the most common and easily addressable vulnerability errors.