Feeds

Google may chuck Spanner into Datastore

Needs to pretty it up or 'people would freak out'

Choosing a cloud hosting partner with confidence

Google I/O Google may make its globally-distributed Spanner database available as a cloud service as the company tries to let developers fiddle with its innards.

The Spanner database* is the successor to the BigTable/Megastore architecture on which Google's just-announced Cloud Datastore is built, and has some more-advanced features, such as snappy access from anywhere in the world for replicated datasets due to its ability to write locally and sync globally without being crushed by latency.

The database could be coming to Google's cloud platform as a standalone service, a Googler hinted on Thursday. But exposing it could be a challenge as the system is so esoteric that it may be difficult for lay developers to access.

"If you were to flip the switch on Google's infrastructure right now and make it public, I think people would freak out," Google cloud product manager Chris Ramsdale said during a panel discussion on distributed databases at Google I/O. "It's not the way everybody wants to program."

However, when asked by a member of the audience if Google would consider making Spanner available to the general public, he said "it's actively being debated", before stressing "not yet."

Because Spanner naturally distributes data across the world while assuring consistency through a clever timestamp feature, there's less need to go between datacenters via fibre to check on replicated pools of data, Ramsdale said, which is how people will need to design system in five to ten years.

"Spanner in many ways is the next evolution of Megastore," he said. "It really gets us to the global footprint".

Google is in the process of discussing how best to surface Spanner, he said, with one possible route being an API on top of it, though another could be a fully managed service. Spanner is an example of the fine line Google needs to walk between wanting to expose its internal infrastructure to the developer community so as to sway applications away from Amazon, and how this creates work through the need to polish and manage the technology as a service.

The approach Google has taken with the Cloud Datastore of breaking apart its infrastructure so it can be consumed as individual services by developers is the "right way" of doing things, Ramsdale said.

When this vulture asked a Googler about the potential difficulties of exposing something like Spanner to the lay user, Google software engineer David Gay indicated it was possible to do so while preserving its neat features. "It's the Spanner servers which have TrueTime, not the clients – in some sense [data is] timestamped at the arrival at the server," Gay said. ®

* Bootnote:

Spanner is designed to work as the data layer for as many as 10 million servers, compared to the million or so that Google operates today. Along with being the successor to BigTable/MegaStore, it has several idiosyncratic features, such as externally consistent distributed transactions, made possible by the fact it depends upon a global fleet of atomic clocks and GPS systems to provide a "TrueTime API" that gets around the timestamping latency problem of operating a global database.

Remote control for virtualized desktops

More from The Register

next story
Just don't blame Bono! Apple iTunes music sales PLUMMET
Cupertino revenue hit by cheapo downloads, says report
The DRUGSTORES DON'T WORK, CVS makes IT WORSE ... for Apple Pay
Goog Wallet apparently also spurned in NFC lockdown
IBM, backing away from hardware? NEVER!
Don't be so sure, so-surers
Hey - who wants 4.8 TERABYTES almost AS FAST AS MEMORY?
China's Memblaze says they've got it in PCIe. Yow
Microsoft brings the CLOUD that GOES ON FOREVER
Sky's the limit with unrestricted space in the cloud
This time it's SO REAL: Overcoming the open-source orgasm myth with TODO
If the web giants need it to work, hey, maybe it'll work
'ANYTHING BUT STABLE' Netflix suffers BIG Europe-wide outage
Friday night LIVE? Nope. The only thing streaming are tears down my face
Google roolz! Nest buys Revolv, KILLS new sales of home hub
Take my temperature, I'm feeling a little bit dizzy
Storage array giants can use Azure to evacuate their back ends
Site Recovery can help to move snapshots around
prev story

Whitepapers

Cloud and hybrid-cloud data protection for VMware
Learn how quick and easy it is to configure backups and perform restores for VMware environments.
Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Intelligent flash storage arrays
Tegile Intelligent Storage Arrays with IntelliFlash helps IT boost storage utilization and effciency while delivering unmatched storage savings and performance.
Website security in corporate America
Find out how you rank among other IT managers testing your website's vulnerabilities.