Feeds

Phew! These DynamoDB queries are heavy. C'mon Amazon, give us a hand

Ah, there you are, and with a fistful of more indexes

Application security programs and practises

Amazon has brought global secondary indexes to its non-relational, rentable DynamoDB database.

The upgrade means cloud wranglers can perform more complicated queries on data stored in the system without having to sacrifice latency. It achieves this by implementing Global Secondary Indexes (GSIs) – a feature that lets admins create additional indexes for the system.

Amazon introduced Local Secondary Indexes (LSIs) in September, which gave admins the ability to locally partition their DynamoDB instance to have up to five additional indexes to use for queries, letting them avoid costly scatter-gather operations and instead run data mining against cached indexes.

Standard DynamoDB splits a data table into attributes, which are roughly analogous to columns. The first two attributes form the hash and the range, and DynamoDB lets you query against either the hash, or the hash and the range.

This lets you fire off queries like 'Show us everything by Team Register [hash]', or using a hash key with a range key, eg 'Show me the ten most recent articles [range] by Team Register [hash]', but more complex queries are difficult.

Now both LSIs and GSIs let admins add in up to five additional indexes, so you can ask more complicated questions like 'Show us the ten most recent articles by Team Register with more than 10 comments that reference LOHAN'.

"With global secondary indexes in DynamoDB, you can now have many indexes and tune their capacity independently. These indexes also provide query/cost flexibility, allowing a custom level of clustering to be defined per index. Developers can specify which attributes should be 'projected' to the secondary index, allowing faster access to often-accessed data, while avoiding extra read/write costs for other attributes," writes Amazon's chief technology officer Werner Vogels in a blog post describing the change.

The rollout of Global Secondary Indexes follows a major price cut of the service by Amazon in May in response to the launch of Google's own Cloud Datastore, and the launch of an offline capability in September to help road-warrior developers test out apps built on the system without having to be online.

Though Amazon's storage (S3) and compute services (EC2) are reckoned to make a shedload of cash, the company has a need to get more sticky data into its cloud to protect against competitors like Windows Azure and Google Compute Engine. Though GSIs are a useful feature, they also encourage cloudy database developers to architect applications for AWS's specific way of doing things – which though not lock-in, does make the Amazon cloud harder to leave. ®

Eight steps to building an HP BladeSystem

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
Apple fanbois SCREAM as update BRICKS their Macbook Airs
Ragegasm spills over as firmware upgrade kills machines
Amazon Reveals One Weird Trick: A Loss On Almost $20bn In Sales
Investors really hate it: Share price plunge as growth SLOWS in key AWS division
SHOCK and AWS: The fall of Amazon's deflationary cloud
Just as Jeff Bezos did to books and CDs, Amazon's rivals are now doing to it
EU's top data cops to meet Google, Microsoft et al over 'right to be forgotten'
Plan to hammer out 'coherent' guidelines. Good luck chaps!
US judge: YES, cops or feds so can slurp an ENTIRE Gmail account
Crooks don't have folders labelled 'drug records', opines NY beak
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
Manic malware Mayhem spreads through Linux, FreeBSD web servers
And how Google could cripple infection rate in a second
prev story

Whitepapers

Top three mobile application threats
Prevent sensitive data leakage over insecure channels or stolen mobile devices.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.