Feeds

AMD: Why we had to evacuate 276TB from Oracle DB to Hadoop

Chip biz CIO Jake Dominguez spills beans to El Reg

Protecting against web application threats using SSL

AMD has migrated terabytes of information from an Oracle Database installation to an Apache Hadoop stack, claiming Oracle's pricey software was suffering from scaling issues.

The chip maker's chief information officer, Jake Dominguez, revealed further details of the transfer in a chat with The Reg.

"Within the common Oracle platform we had we were struggling from a performance and reliability perspective," Dominguez told your correspondent in Atlanta just before the weekend. "One of the areas we were struggling with was in our test and assembly manufacturing – large, large datasets."

The migration of 276TB of data, which was completed last year, was prompted by "an environment outage that took weeks to recover," according to an internal document seen by El Reg. This encouraged AMD to replace Oracle for something else.

In the end, the processor giant settled on using Cloudera's Hadoop distribution along additional open-source projects Apache Hive, ZooKeeper, HBase, HDFS, httpfs, LZO compression, MapReduce and others.

According to AMD, the Hadoop software has an unlimited row limit for query results compared to 100,000 rows on the chip giant's Oracle setup, and "99 per cent of all queries execute in 15 minutes or less, with a median execution time of just 23 seconds."

What makes this shift so significant is that Oracle wants you to think AMD is the sort of company that will always use Oracle kit.

Oracle is grappling with a shift in the data warehouse and analytics market: its core business is being squeezed by free and open-source on-premises software, and its cloud wing is facing off with Amazon Web Services and the like.

Many organizations have sought to extricate themselves from Oracle's grip, either by swapping out Oracle-owned open-source tech for other software, as Google did with a vast MySQL to MariaDB migration, or by shifting away from the company's proprietary databases to open-source ones, as the UK's National Health Service did with a major Riak migration.

One of the main open-source technologies commonly being deployed to supplement or replace Oracle is Hadoop, a data storage and processing framework that was first developed at Yahoo! in 2005 by engineers attempting to replicate some advanced technologies invented at Google.

Today, software like Hadoop, and other distributed data storage and management frameworks like Cassandra and Riak, are competing with software from IBM, SAP, and most prominently Oracle.

For AMD, a sophisticated multinational manufacturing company, to launch a major Oracle migration project is representative of a broader shift in IT which benefits low-cost or free software at the expense of incumbents like Oracle.

"We made the pivot to Hadoop [and] it not only increased our reliability but [improved] our response time," Dominguez told us. "It's going to be an integral part of our enterprise data warehouse concept." ®

Internet Security Threat Report 2014

More from The Register

next story
Phones 4u slips into administration after EE cuts ties with Brit mobe retailer
More than 5,500 jobs could be axed if rescue mission fails
JINGS! Microsoft Bing called Scots indyref RIGHT!
Redmond sporran metrics get one in the ten ring
Driving with an Apple Watch could land you with a £100 FINE
Bad news for tech-addicted fanbois behind the wheel
Murdoch to Europe: Inflict MORE PAIN on Google, please
'Platform for piracy' must be punished, or it'll kill us in FIVE YEARS
Bono: Apple will sort out monetising music where the labels failed
Remastered so hard it would be difficult or impossible to master it again
Phones 4u website DIES as wounded mobe retailer struggles to stay above water
Founder blames 'ruthless network partners' for implosion
Found inside ISIS terror chap's laptop: CELINE DION tunes
REPORT: Stash of terrorist material found in Syria Dell box
Sony says year's losses will be FOUR TIMES DEEPER than thought
Losses of more than $2 BILLION loom over troubled Japanese corp
prev story

Whitepapers

Secure remote control for conventional and virtual desktops
Balancing user privacy and privileged access, in accordance with compliance frameworks and legislation. Evaluating any potential remote control choice.
WIN a very cool portable ZX Spectrum
Win a one-off portable Spectrum built by legendary hardware hacker Ben Heck
Intelligent flash storage arrays
Tegile Intelligent Storage Arrays with IntelliFlash helps IT boost storage utilization and effciency while delivering unmatched storage savings and performance.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Beginner's guide to SSL certificates
De-mystify the technology involved and give you the information you need to make the best decision when considering your online security options.