Feeds

Dream job ad appears: Data wrangler for Square Kilometre Array

Curtin University seeks extreme sysadmin for Murchison 'scope

Security for virtualized datacentres

Australia's Square Kilometre Array boffins – courtesy of Curtin University – have put up the spec for might just be a dream sysadmin job, so long as they're ready, willing and able to cope with what will ultimately be one of the world's biggest data firehoses.

As already recorded by The Register, the Square Kilometre Array precursor, the Murchison Widefield Array, began streaming data last year, and what a stream it is. Back then, the hundreds of tiles totalling 2,048 individual antennas were shipping 400 MB per second back to Pawsey.

The link has since been upgraded to 8 Tbps.

That has to be filtered before it's stored: the raw data of 1.5 TB per hour is thinned down to a mere 3 PB a year (deciding what to throw away is one of the great computing challenges of the SKA project).

Hence Curtin University is looking for someone to work with Pawsey staff to handle that data – an archive that will reach around 9 PB by next year.

Pawsey is soon to be home to a 35,000-core Intel Xeon E5-2600 v3-based machine, the most powerful south of the equator.

The job ad says that the core responsibility will be “the operation and maintenance of the data flow and data archiving between the MWA project and the Pawsey supercomputing centre. Working closely with staff at the Pawsey supercomputing centre you will ensure best practice treatment of the MWA Big Data challenge, with the future view of making MWA data widely and easily available to an international user community.”

Unsurprisingly, a “demonstrated ability to manage the operation and maintenance of a complex large-scale data system is essential”. ®

Secure remote control for conventional and virtual desktops

More from The Register

next story
Microsoft changes cert test providers, hints at fun new exams
If you really love taking tests with Prometric, do 'em before Christmas
Blighty's mighty tech skills shortage drives best job growth in years
Doesn't anyone know anything about SQL? Or Java? Or Linux? Or programming? Or...
Amazon hiring in Australia for 'new and confidential Amazon Fresh initiative'
Is Jeff Bezos moving his grocery business beyond the US West Coast?
Symantec security chap signs for CSIRO's ICT In Schools
Vulture South is closing in on our goal of 20 new recruits to help teachers and kids
A-level results: Before you smile at that jump-for-joy snap...
Uni-ditching teens are COMING FOR YOUR JOBS
How to promote CSIRO's ICT in Schools in your community
Vulture South is closing in on its target to find volunteers to help teach tech in schools
Everyone's an IoT expert but now there's a certificate to prove it
Cisco creates Certification of Things for industrial sensor-footlers
Facebook wants Linux networking as good as FreeBSD
Help The Social NetworkTM make the kernel better
LinkedIn settles missed overtime pay case: Will pay $6m to staffers
US Dept of Labor: It violated Fair Labor Standards Act
prev story

Whitepapers

Providing a secure and efficient Helpdesk
A single remote control platform for user support is be key to providing an efficient helpdesk. Retain full control over the way in which screen and keystroke data is transmitted.
Top 5 reasons to deploy VMware with Tegile
Data demand and the rise of virtualization is challenging IT teams to deliver storage performance, scalability and capacity that can keep up, while maximizing efficiency.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.
Secure remote control for conventional and virtual desktops
Balancing user privacy and privileged access, in accordance with compliance frameworks and legislation. Evaluating any potential remote control choice.