Feeds

Teradata Universe in Warsaw

Is data warehousing writ large an opportunity for developers?

Intelligent flash storage arrays

After a couple of days with the Teradata people at its Universe Conference 2007 (22-25 April), I'm seriously impressed.

I like Teradata's "one data warehouse" concept, with all the disaggregated data in a normalised store. I like the way it separates the logical views of the data (including the semantic view) from underlying physical database.

And, I think I even understand the use of hashing rather than indexing to get at the stored data and why it is faster (basically, you hash the key to get a unique location on disk, which is a bit less efficient than just adding it in the next available space in an indexed database, but thereafter you can go straight to the data without any indexing overheads) – because that is how IBM's IMS HDAM databases work (albeit IMS is optimised for transaction processing rather than retrieval).

Teradata chooses to market to the largest companies in any space, so its installations are usually big and expensive, but it can scale down – in Finland, for example, it might have customers with comparatively small data warehouses, because there aren't that many people in Finland.

There is also a flourishing developer community and I hope to explore this more in the future. Could there be advantages for a developer moving into a comparatively specialised space such as Teradata application development?

The general theme of the conference is "embracing active enterprise intelligence" - and an excellent point was made that fact-based decision-making often needs near-real-time information and that the real metric for any data warehouse is the active use of its data to make decisions

An interesting announcement at the conference was "multi temperature" data warehousing – automatic management of "hot" (frequently accessed) data and "cold" (less accessed) data in the same warehouse, with management in logical (SLA) terms instead of physical terms.

So, the data you need for near-real-time operational decisions) might be on expensive "enterprise quality" disks and the stuff kept just for contingency regulatory reports on something more commodity level – and this would be transparent to the data users/owners who just specify the appropriate service level. This doesn't handle migration to archive/backup yet, but it might in the future.

This is interesting and (as far as I can see) new to data warehousing. Although, of course, IMS implemented something similar in the OLTP space years ago and IBM has had logical object-based data migration tools for some time.

Another interesting development is a partnership between Microsoft and Teradata, so that Microsoft's excellent BI tools can be used against Teradata data warehouses. I did ask if this was a tacit admission that SQL Server couldn't scale and was told by Microsoft (I paraphrase) "not exactly".

Teradata's conference recital at the Opera House in Warsaw.But Mark Whitehorn points out that Teradata's Inmon-style single warehouse appears to be in conflict with SQLServer's data mart approach (which neatly avoids any scalability issues, for a while at least) and I've asked him to explore this in a future article.

One more thing to remember is that Teradata is splitting off as an independent company from NCR soon, and that might generate new opportunities. On the whole then, an informative conference – and Warsaw's hospitality was excellent. I particularly enjoyed the mezzo recital Teradata provided at its Opera House gala. ®

Top 5 reasons to deploy VMware with Tegile

More from The Register

next story
PEAK APPLE: iOS 8 is least popular Cupertino mobile OS in all of HUMAN HISTORY
'Nerd release' finally staggers past 50 per cent adoption
Microsoft to bake Skype into IE, without plugins
Redmond thinks the Object Real-Time Communications API for WebRTC is ready to roll
Microsoft promises Windows 10 will mean two-factor auth for all
Sneak peek at security features Redmond's baking into new OS
Mozilla: Spidermonkey ATE Apple's JavaScriptCore, THRASHED Google V8
Moz man claims the win on rivals' own benchmarks
FTDI yanks chip-bricking driver from Windows Update, vows to fight on
Next driver to battle fake chips with 'non-invasive' methods
DEATH by PowerPoint: Microsoft warns of 0-day attack hidden in slides
Might put out patch in update, might chuck it out sooner
Ubuntu 14.10 tries pulling a Steve Ballmer on cloudy offerings
Oi, Windows, centOS and openSUSE – behave, we're all friends here
Was ist das? Eine neue Suse Linux Enterprise? Ausgezeichnet!
Version 12 first major-number Suse release since 2009
prev story

Whitepapers

Why and how to choose the right cloud vendor
The benefits of cloud-based storage in your processes. Eliminate onsite, disk-based backup and archiving in favor of cloud-based data protection.
Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Storage capacity and performance optimization at Mizuno USA
Mizuno USA turn to Tegile storage technology to solve both their SAN and backup issues.
Simplify SSL certificate management across the enterprise
Simple steps to take control of SSL across the enterprise, and recommendations for a management platform for full visibility and single-point of control for these Certificates.