Feeds

SQL fights back against NoSQL's big data cred with SQL/MDA spec

The empire strikes back with multi-dimensional arrays

Build a business case: developing custom apps

With the growing popularity of big-data tools like NoSQL databases and Hadoop, it might have looked like SQL could be in line to be moved on from “venerable” tag to “obsolete”, but last week, the ISO SQL working group agreed to start work on SQL/MDA (multi-dimensional array) specs.

The people behind SQL have decided it's time to get serious (really, really serious) about big (as in really, really big) multidimensional datasets, and have kicked off an effort to extend the standard, adding the new capabilities needed by spatial, scientific, engineering and medical users.

As spatial publication GIM International notes, SQL doesn't offer an elegant way to handle the kinds of arrays generated by scientific big data. For example, meteorology might maintain four-dimensional data sets covering location, altitude and time, and those kinds of arrays are held and processed in other environments, even if the data stores are then referenced in an SQL database.

Similarly, data collected by big sensor networks can easily become multi-dimensional – and even if the volume data isn't out of this world, the multi-dimensional nature of data sets puts them beyond SQL.

A separate effort, called Rasdaman (a scalable multi-dimensional array analytics server) has been working for some time to apply an SQL-like query language to array databases. Rasdaman's backer, Peter Baumann of Jacobs University Bremen in Germany, put forward the proposal now adopted by the ISO.

Rasdaman, GIM says, has showed impressive results: “In a recent technology demonstration, more than 1,000 computers collaborated in a cloud to jointly compute the result of a single database query. This ‘distributed query processing’ means a massive speed increase, and research challenges on multi-Petabyte data cubes can be answered that were previously unsolvable,” the outlet writes.

Rasdaman has also shown good adoption in the open source GIS world, being adopted by the ubiquitous GDAL (Geospatial Data Abstraction Library) as a library component, and with MapServer integration in beta. ®

The essential guide to IT transformation

More from The Register

next story
Munich considers dumping Linux for ... GULP ... Windows!
Give a penguinista a hug, the Outlook's not good for open source's poster child
The Return of BSOD: Does ANYONE trust Microsoft patches?
Sysadmins, you're either fighting fires or seen as incompetents now
Intel's Raspberry Pi rival Galileo can now run Windows
Behold the Internet of Things. Wintel Things
Microsoft cries UNINSTALL in the wake of Blue Screens of Death™
Cache crash causes contained choloric calamity
Time to move away from Windows 7 ... whoa, whoa, who said anything about Windows 8?
Start migrating now to avoid another XPocalypse – Gartner
Eat up Martha! Microsoft slings handwriting recog into OneNote on Android
Freehand input on non-Windows kit for the first time
You'll find Yoda at the back of every IT conference
The piss always taking is he. Bastard the.
prev story

Whitepapers

Endpoint data privacy in the cloud is easier than you think
Innovations in encryption and storage resolve issues of data privacy and key requirements for companies to look for in a solution.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Top 8 considerations to enable and simplify mobility
In this whitepaper learn how to successfully add mobile capabilities simply and cost effectively.
Solving today's distributed Big Data backup challenges
Enable IT efficiency and allow a firm to access and reuse corporate information for competitive advantage, ultimately changing business outcomes.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.