Feeds

Dream job ad appears: Data wrangler for Square Kilometre Array

Curtin University seeks extreme sysadmin for Murchison 'scope

The Essential Guide to IT Transformation

Australia's Square Kilometre Array boffins – courtesy of Curtin University – have put up the spec for might just be a dream sysadmin job, so long as they're ready, willing and able to cope with what will ultimately be one of the world's biggest data firehoses.

As already recorded by The Register, the Square Kilometre Array precursor, the Murchison Widefield Array, began streaming data last year, and what a stream it is. Back then, the hundreds of tiles totalling 2,048 individual antennas were shipping 400 MB per second back to Pawsey.

The link has since been upgraded to 8 Tbps.

That has to be filtered before it's stored: the raw data of 1.5 TB per hour is thinned down to a mere 3 PB a year (deciding what to throw away is one of the great computing challenges of the SKA project).

Hence Curtin University is looking for someone to work with Pawsey staff to handle that data – an archive that will reach around 9 PB by next year.

Pawsey is soon to be home to a 35,000-core Intel Xeon E5-2600 v3-based machine, the most powerful south of the equator.

The job ad says that the core responsibility will be “the operation and maintenance of the data flow and data archiving between the MWA project and the Pawsey supercomputing centre. Working closely with staff at the Pawsey supercomputing centre you will ensure best practice treatment of the MWA Big Data challenge, with the future view of making MWA data widely and easily available to an international user community.”

Unsurprisingly, a “demonstrated ability to manage the operation and maintenance of a complex large-scale data system is essential”. ®

7 Elements of Radically Simple OS Migration

More from The Register

next story
Pinterest diversity stats: Also pale and male (but not as much as Twitter)
Cats'n'flowers site latest to admit white men rule its roost
MoJ IT workers 'n' pals extend strike action over privatisation
Fears of cuts when shared services gig moves to Steria
Pleased to meet you. I'm Joe Bloggs, MVP, vExpert, Cisco Champ
What a mouthful. Do customers care? Six title-holders quizzed
The Register is HIRING technology hacks for the WORLD
Live on Earth? Want to be a Vulture? Enquire within
Microsoft's MCSE and MCSD will become HARDER to win
Redmond decides it won't replace Masters certifications, so lesser certs get more rigour
'Oh my god – Mark Zuckerberg wants to meet me'
'The Swiss have got no great interest in working with Apple'
Dammit, Foxconn: Where's our 1 MILLION-strong robot ARMY?
'Foxbots' just aren't good enough to take up the slack
Devs: Fancy a job teaching Siri to speak the Queen's English?
Spik propa lyk dis blud innit, ya get me?
Bankers bid to use offshore temp techies
WikiLeaks publishes Financial Services Annex to 50-nation Trade in Services Agreement
prev story

Whitepapers

7 Elements of Radically Simple OS Migration
Avoid the typical headaches of OS migration during your next project by learning about 7 elements of radically simple OS migration.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
Solving today's distributed Big Data backup challenges
Enable IT efficiency and allow a firm to access and reuse corporate information for competitive advantage, ultimately changing business outcomes.
A new approach to endpoint data protection
What is the best way to ensure comprehensive visibility, management, and control of information on both company-owned and employee-owned devices?