Feeds

Google's BigQuery gets data slurping capability

'Streaming' feature lets it suck rows rather than nosh batches

Designing a Defense for Mobile Applications

Instead of having to upload stuff into the Google cloud and then feed it through to BigQuery, cloud wranglers can now stream data directly into the Chocolate Factory's analytics-as-a-service tech.

Google announced the "streaming data" update to BigQuery on Wednesday and it means admins can pour data into the service and start analysing it quickly, rather than waiting to upload it into the Google cloud storage layer in bulk.

Doing this speeds access to data and real-time insertions, Google says, but risks "possible data duplication" and "possible connection drops."

Appropriate applications for the service include ones that are constantly generating data that needs need quick-turnaround analysis, such as dashboards.

"The new data is available for querying instantaneously. This feature is great for time sensitive use cases like log analysis and alerts generation," Felipe Hoffa, a Google developer programs engineer, said.

However, limits apply for streaming: the system can ingest 100 rows per second, per table, though Google will permit "occasional bursts of up to 1,000 rows per second." The maximum row size is 100KB and the maximum data size per streaming insert is 1MB.

The upgrade follows Google introducing SQL-like commands such as JOIN into the technology in March, and cutting the price of data storage costs from $0.12 per gigabyte to $0.08 in June.

Streaming data will be free until January 1, 2014, at which point it will cost 1 cent per 10,000 rows inserted, Google wrote. ®

The Power of One eBook: Top reasons to choose HP BladeSystem

More from The Register

next story
Apple fanbois SCREAM as update BRICKS their Macbook Airs
Ragegasm spills over as firmware upgrade kills machines
Attack of the clones: Oracle's latest Red Hat Linux lookalike arrives
Oracle's Linux boss says Larry's Linux isn't just for Oracle apps anymore
THUD! WD plonks down SIX TERABYTE 'consumer NAS' fatboy
Now that's a LOT of porn or pirated movies. Or, you know, other consumer stuff
EU's top data cops to meet Google, Microsoft et al over 'right to be forgotten'
Plan to hammer out 'coherent' guidelines. Good luck chaps!
US judge: YES, cops or feds so can slurp an ENTIRE Gmail account
Crooks don't have folders labelled 'drug records', opines NY beak
Manic malware Mayhem spreads through Linux, FreeBSD web servers
And how Google could cripple infection rate in a second
FLAPE – the next BIG THING in storage
Find cold data with flash, transmit it from tape
prev story

Whitepapers

Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Reducing security risks from open source software
Follow a few strategies and your organization can gain the full benefits of open source and the cloud without compromising the security of your applications.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Consolidation: the foundation for IT and business transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.