Feeds

Dream job ad appears: Data wrangler for Square Kilometre Array

Curtin University seeks extreme sysadmin for Murchison 'scope

Beginner's guide to SSL certificates

Australia's Square Kilometre Array boffins – courtesy of Curtin University – have put up the spec for might just be a dream sysadmin job, so long as they're ready, willing and able to cope with what will ultimately be one of the world's biggest data firehoses.

As already recorded by The Register, the Square Kilometre Array precursor, the Murchison Widefield Array, began streaming data last year, and what a stream it is. Back then, the hundreds of tiles totalling 2,048 individual antennas were shipping 400 MB per second back to Pawsey.

The link has since been upgraded to 8 Tbps.

That has to be filtered before it's stored: the raw data of 1.5 TB per hour is thinned down to a mere 3 PB a year (deciding what to throw away is one of the great computing challenges of the SKA project).

Hence Curtin University is looking for someone to work with Pawsey staff to handle that data – an archive that will reach around 9 PB by next year.

Pawsey is soon to be home to a 35,000-core Intel Xeon E5-2600 v3-based machine, the most powerful south of the equator.

The job ad says that the core responsibility will be “the operation and maintenance of the data flow and data archiving between the MWA project and the Pawsey supercomputing centre. Working closely with staff at the Pawsey supercomputing centre you will ensure best practice treatment of the MWA Big Data challenge, with the future view of making MWA data widely and easily available to an international user community.”

Unsurprisingly, a “demonstrated ability to manage the operation and maintenance of a complex large-scale data system is essential”. ®

Remote control for virtualized desktops

More from The Register

next story
What a Mesa: Apple vows to re-use titsup GT sapphire glass plant
Commits to American manufacturing ... of secret tech
Sarong it's right: Coining it in Thailand without a visa
Top money, cheap rent and food ... and fear of a late-night knock
Adobe appoints former Reg man as open-source chief mobile lead
Proprietary player prepping for community skoolin'
Young Germans: PLEASE! ANYTHING BUT a digital STARTUP
But Spanish and Italian youths want to set them up themselves
Get a job in Germany – where most activities are precursors to drinking
A Brit explains the fun to be had rolling rocks down country lanes
Amazon hiring drone flight ops engineer in Cambridge, UK
Your mission, should you choose to accept it, is running test flights for Prime Air delivery drones
prev story

Whitepapers

Why and how to choose the right cloud vendor
The benefits of cloud-based storage in your processes. Eliminate onsite, disk-based backup and archiving in favor of cloud-based data protection.
Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Protecting users from Firesheep and other Sidejacking attacks with SSL
Discussing the vulnerabilities inherent in Wi-Fi networks, and how using TLS/SSL for your entire site will assure security.
Saudi Petroleum chooses Tegile storage solution
A storage solution that addresses company growth and performance for business-critical applications of caseware archive and search along with other key operational systems.