Feeds

SQL fights back against NoSQL's big data cred with SQL/MDA spec

The empire strikes back with multi-dimensional arrays

Internet Security Threat Report 2014

With the growing popularity of big-data tools like NoSQL databases and Hadoop, it might have looked like SQL could be in line to be moved on from “venerable” tag to “obsolete”, but last week, the ISO SQL working group agreed to start work on SQL/MDA (multi-dimensional array) specs.

The people behind SQL have decided it's time to get serious (really, really serious) about big (as in really, really big) multidimensional datasets, and have kicked off an effort to extend the standard, adding the new capabilities needed by spatial, scientific, engineering and medical users.

As spatial publication GIM International notes, SQL doesn't offer an elegant way to handle the kinds of arrays generated by scientific big data. For example, meteorology might maintain four-dimensional data sets covering location, altitude and time, and those kinds of arrays are held and processed in other environments, even if the data stores are then referenced in an SQL database.

Similarly, data collected by big sensor networks can easily become multi-dimensional – and even if the volume data isn't out of this world, the multi-dimensional nature of data sets puts them beyond SQL.

A separate effort, called Rasdaman (a scalable multi-dimensional array analytics server) has been working for some time to apply an SQL-like query language to array databases. Rasdaman's backer, Peter Baumann of Jacobs University Bremen in Germany, put forward the proposal now adopted by the ISO.

Rasdaman, GIM says, has showed impressive results: “In a recent technology demonstration, more than 1,000 computers collaborated in a cloud to jointly compute the result of a single database query. This ‘distributed query processing’ means a massive speed increase, and research challenges on multi-Petabyte data cubes can be answered that were previously unsolvable,” the outlet writes.

Rasdaman has also shown good adoption in the open source GIS world, being adopted by the ubiquitous GDAL (Geospatial Data Abstraction Library) as a library component, and with MapServer integration in beta. ®

Internet Security Threat Report 2014

More from The Register

next story
Euro Parliament VOTES to BREAK UP GOOGLE. Er, OK then
It CANNA do it, captain.They DON'T have the POWER!
Download alert: Nearly ALL top 100 Android, iOS paid apps hacked
Attack of the Clones? Yeah, but much, much scarier – report
NSA SOURCE CODE LEAK: Information slurp tools to appear online
Now you can run your own intelligence agency
Post-Microsoft, post-PC programming: The portable REVOLUTION
Code jockeys: count up and grab your fabulous tablets
Twitter App Graph exposes smartphone spyware feature
You don't want everyone to compile app lists from your fondleware? BAD LUCK
Microsoft adds video offering to Office 365. Oh NOES, you'll need Adobe Flash
Lovely presentations... but not on your Flash-hating mobe
prev story

Whitepapers

10 ways wire data helps conquer IT complexity
IT teams can automatically detect problems across the IT environment, spot data theft, select unique pieces of transaction payloads to send to a data source, and more.
Getting started with customer-focused identity management
Learn why identity is a fundamental requirement to digital growth, and how without it there is no way to identify and engage customers in a meaningful way.
How to determine if cloud backup is right for your servers
Two key factors, technical feasibility and TCO economics, that backup and IT operations managers should consider when assessing cloud backup.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Mitigating web security risk with SSL certificates
Web-based systems are essential tools for running business processes and delivering services to customers.