Feeds

Dream job ad appears: Data wrangler for Square Kilometre Array

Curtin University seeks extreme sysadmin for Murchison 'scope

The smart choice: opportunity from uncertainty

Australia's Square Kilometre Array boffins – courtesy of Curtin University – have put up the spec for might just be a dream sysadmin job, so long as they're ready, willing and able to cope with what will ultimately be one of the world's biggest data firehoses.

As already recorded by The Register, the Square Kilometre Array precursor, the Murchison Widefield Array, began streaming data last year, and what a stream it is. Back then, the hundreds of tiles totalling 2,048 individual antennas were shipping 400 MB per second back to Pawsey.

The link has since been upgraded to 8 Tbps.

That has to be filtered before it's stored: the raw data of 1.5 TB per hour is thinned down to a mere 3 PB a year (deciding what to throw away is one of the great computing challenges of the SKA project).

Hence Curtin University is looking for someone to work with Pawsey staff to handle that data – an archive that will reach around 9 PB by next year.

Pawsey is soon to be home to a 35,000-core Intel Xeon E5-2600 v3-based machine, the most powerful south of the equator.

The job ad says that the core responsibility will be “the operation and maintenance of the data flow and data archiving between the MWA project and the Pawsey supercomputing centre. Working closely with staff at the Pawsey supercomputing centre you will ensure best practice treatment of the MWA Big Data challenge, with the future view of making MWA data widely and easily available to an international user community.”

Unsurprisingly, a “demonstrated ability to manage the operation and maintenance of a complex large-scale data system is essential”. ®

Boost IT visibility and business value

More from The Register

next story
Microsoft's MCSE and MCSD will become HARDER to win
Redmond decides it won't replace Masters certifications, so lesser certs get more rigour
'Oh my god – Mark Zuckerberg wants to meet me'
'The Swiss have got no great interest in working with Apple'
Dammit, Foxconn: Where's our 1 MILLION-strong robot ARMY?
'Foxbots' just aren't good enough to take up the slack
Devs: Fancy a job teaching Siri to speak the Queen's English?
Spik propa lyk dis blud innit, ya get me?
Bankers bid to use offshore temp techies
WikiLeaks publishes Financial Services Annex to 50-nation Trade in Services Agreement
Hey! Where! are! the! white! women! at!? It's! Yahoo!
In non-tech jobs, that is – still mostly white men running Marissa Mayer's web biz
Non-techies: The cute things they say
'OK, smartass, the firewall is blocking the proxy server.'
Join me, Reg readers, and help me UPGRADE our CHILDREN
Think of the children? I just did, says Dom Connor
Dream job ad appears: Data wrangler for Square Kilometre Array
Curtin University seeks extreme sysadmin for Murchison 'scope
prev story

Whitepapers

Seven Steps to Software Security
Seven practical steps you can begin to take today to secure your applications and prevent the damages a successful cyber-attack can cause.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.
Consolidation: the foundation for IT and business transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.