Feeds

I used to be an Oracle DBA ... but now I'm a Big Data guru

Dominic Connor shows you how to jump the bandwagon

Bridging the IT gap between rising business demands and ageing tools

As the demand for Oracle skills fades along with VB and as even Java loses its shine, the smart developer is looking at what will pay the bills for the next decade.

As an ITpro you have to bet your career every few years and Big Data is too obvious an opportunity to pass up. The problem being that it’s not a single product that you can cross-train into, but rather a new set of methods as well as tools.

You can’t handle the (Big) truth

Apparently I’m not the most valuable writer at The Reg, our wise leadership has crossed sales of adverts with click data to work that out. However, I’m too petty to tell you who is #1 because that is actionable data, since a rational response is a positive feedback loop pushing the parts of your business that make money and fixing or junking parts that don’t.

Talking to Duncan Ross, who evangelises Big Data for Teradata, I discover that the first skill you need to develop is the mindset of working out what would be good to know so that you can use it. Being interesting is necessary but not sufficient.

This illustrates that like most industry buzzwords, “Big” is a cynical spin on what should more often be called “awkward”. A billion rows of normalised data in a well-designed schema might be large, but it's hard to see a big pay packet coming from running an aggregate function like Average on it. To be a lucrative skill there has to be some pain that you can overcome for your patient employer.

Crossing databases can be deliciously hard and that’s why I commend it to you as a skill in which to invest. Easy skills may shine brightly for a while, but market forces (people reading this article and job ads) will drag your price down. This is far more than getting Oracle to coexist with SQL Server using toolsets like DTS, because increasingly a large percentage of your most useful data is in clouds - like BlackLine for accounts or Salesforce for (surprise) sales which can use SQL, as does your in-house HR DB. Be clear that they are each different flavours of SQL, with entities not in any kind of mutually consistent form. Also note that inter-cloud interoperability is still at a laughably primitive stage, so that’s your opening. Part of the joy of integration is that the set multiplies with each system you add to the mix - meaning there is lots of work to be done for which they will pay you.

We’ve been crossing databases together for decades, often with extra indexes, or massive slow batch imports of data followed by an equally slow (and often less than reliable) batch download. That’s not only clunky, but is rapidly going downhill as a career option and because it’s just you and me here, we can be honest about this.

YOU know how the Fat Controller (yes, it’s called that at one bank) sucks in data and no one else does, not well enough that they’d ever dare lose you. That’s good until the day that some jerk whispers “Hadoop” into the ear of your CIO. Then what you have are non-portable skills that can only be used in one firm which is phasing them out. This is so bad that you must be that jerk. It's better to be leading the charge than be ridden over and even if the project goes titsup, Hadoop is a pretty good word to have on your CV.

Hadoop’s open-sourciness and use of commodity hardware is both good and bad for your CV upgrade because this means the barrier to entry is a bit lower than it would be if learning the skill required access to a huge pile of expensive hardware and software. This means the clock has already started ticking quietly while the other seven million people who read this article pile in... Nevertheless, the value of this information won’t degrade anything like as fast as your expertise in proprietary system. As IT Pros we're always walking up the down escalator, but it’s best to pick one that’s moving slower and has fewer people in the way.

Seven Steps to Software Security

More from The Register

next story
BBC goes offline in MASSIVE COCKUP: Stephen Fry partly muzzled
Auntie tight-lipped as major outage rolls on
iPad? More like iFAD: We reveal why Apple fell into IBM's arms
But never fear fanbois, you're still lapping up iPhones, Macs
Nadella: Apps must run on ALL WINDOWS – PCs, slabs and mobes
Phone egg, meet desktop chicken - your mother
White? Male? You work in tech? Let us guess ... Twitter? We KNEW it!
Grim diversity numbers dumped alongside Facebook earnings
HP, Microsoft prove it again: Big Business doesn't create jobs
SMEs get lip service - what they need is dinner at the Club
ITC: Seagate and LSI can infringe Realtek patents because Realtek isn't in the US
Land of the (get off scot) free, when it's a foreign owner
Dude, you're getting a Dell – with BITCOIN: IT giant slurps cryptocash
1. Buy PC with Bitcoin. 2. Mine more coins. 3. Goto step 1
There's NOTHING on TV in Europe – American video DOMINATES
Even France's mega subsidies don't stop US content onslaught
You! Pirate! Stop pirating, or we shall admonish you politely. Repeatedly, if necessary
And we shall go about telling people you smell. No, not really
prev story

Whitepapers

Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Reducing security risks from open source software
Follow a few strategies and your organization can gain the full benefits of open source and the cloud without compromising the security of your applications.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Consolidation: the foundation for IT and business transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.