Feeds

Dream job ad appears: Data wrangler for Square Kilometre Array

Curtin University seeks extreme sysadmin for Murchison 'scope

Intelligent flash storage arrays

Australia's Square Kilometre Array boffins – courtesy of Curtin University – have put up the spec for might just be a dream sysadmin job, so long as they're ready, willing and able to cope with what will ultimately be one of the world's biggest data firehoses.

As already recorded by The Register, the Square Kilometre Array precursor, the Murchison Widefield Array, began streaming data last year, and what a stream it is. Back then, the hundreds of tiles totalling 2,048 individual antennas were shipping 400 MB per second back to Pawsey.

The link has since been upgraded to 8 Tbps.

That has to be filtered before it's stored: the raw data of 1.5 TB per hour is thinned down to a mere 3 PB a year (deciding what to throw away is one of the great computing challenges of the SKA project).

Hence Curtin University is looking for someone to work with Pawsey staff to handle that data – an archive that will reach around 9 PB by next year.

Pawsey is soon to be home to a 35,000-core Intel Xeon E5-2600 v3-based machine, the most powerful south of the equator.

The job ad says that the core responsibility will be “the operation and maintenance of the data flow and data archiving between the MWA project and the Pawsey supercomputing centre. Working closely with staff at the Pawsey supercomputing centre you will ensure best practice treatment of the MWA Big Data challenge, with the future view of making MWA data widely and easily available to an international user community.”

Unsurprisingly, a “demonstrated ability to manage the operation and maintenance of a complex large-scale data system is essential”. ®

Top 5 reasons to deploy VMware with Tegile

More from The Register

next story
Looking for a job in Europe? Experienced IT staff needed in UK, Italy and Germany
New graduates need life skills, says Euro Commish report
‘For the love of Pete, America, learn about decent chocolate’
If that's your only gripe about a life in LA, lucky you!
IT JOB OUTSOURCING: Will it ever END?
Let's look at the economics behind it...
The 'fun-nification' of computer education – good idea?
Compulsory code schools, luvvies love it, but what about Maths and Physics?
Want to break Netflix? It'll pay you to do the job
'Senior Chaos Engineer' sought to inflict all sorts of nasty, nasty, pain
HOT BABES! Worried you won't get that JOB in IT? MENTION how hot you are
'Don't hate me 'cos I'm beautiful' ploy for sad honeys
Oracle to DBAs: your certification is about to become worthless paper
So hurry up and get a new one, will all of you who took exams for 10g and lower?
prev story

Whitepapers

Why cloud backup?
Combining the latest advancements in disk-based backup with secure, integrated, cloud technologies offer organizations fast and assured recovery of their critical enterprise data.
Getting started with customer-focused identity management
Learn why identity is a fundamental requirement to digital growth, and how without it there is no way to identify and engage customers in a meaningful way.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
New hybrid storage solutions
Tackling data challenges through emerging hybrid storage solutions that enable optimum database performance whilst managing costs and increasingly large data stores.
Mitigating web security risk with SSL certificates
Web-based systems are essential tools for running business processes and delivering services to customers.