Feeds

DARPA killer AI robots to 'participate in own construction'

Foolish meatsack! OF COURSE I need nuclear weapons!

Beginner's guide to SSL certificates

You've got your robots which can make copies of themselves, of course. That's pretty scary - a runaway exponentially-multiplying machine horde, potentially able to overrun the human race in an eyeblink. But how much more scary would it be if you had a machine which could not only make copies of itself once complete, but could also participate in its own construction while it was still being built?

Really quite a lot more scary, we say here on the Reg mechanoid-armageddon desk. That's why we would never be suitable for employment at DARPA, the famed US military tech bureau where they care not what deadly man-eating monster worm plagues may be unleashed during tests of a new laser-powered can opener.

Yes, it's true. DARPA have now expanded somewhat on their intention to initiate a programme called Self-Explanation Learning Framework (SELF), which they explain thus:

DARPA seeks to construct systems that can participate in their own construction... The system might know the requirements for various tasks in its repertoire, and it may try to perform those tasks to verify functionality.

We particularly liked that last bit. One should bear in mind that Dr Mike Cox of DARPA has already said that SELF could be placed in charge "in the near term" of heavily armoured, hideously beweaponed main battle tanks or strike planes laden with blockbuster bombs.

"Tasks in its repertoire", then, might include "destroy all moving objects within 100 miles not designated as 'friendly'" or "mount an immediate armoured assault on Beijing, regardless of nuclear response". The prospect of the software unilaterally "trying to perform those tasks to verify functionality" doesn't seem reassuring.

In any case, it seems plain that building a system focused on "high-level cognition" which can "participate in its own construction" will be fraught with difficulty. You might have a notion of what you'd like it to be, but it will have its own ideas. By definition, one would have no firm picture of just what would be unleashed upon an unsuspecting world at the end of the construction process - but you would know that it'd be potentially able to make more of itself, or indeed repair itself if it got damaged.

It might also be rather difficult to stop the process of building the SELF, once it had advanced beyond a certain point. Frankly the only way to be sure it can be stopped would seem to be to stop it now.

But that's not the plan. Dr Cox and his DARPA chums are holding an industry day for those interested in building starting the building of SELF. The details are here in a pdf, and a website is given where attendees can make known their "special needs" (for instance supervised day release from the Asylum for Troubled Scientists). ®

Choosing a cloud hosting partner with confidence

More from The Register

next story
Renewable energy 'simply WON'T WORK': Top Google engineers
Windmills, solar, tidal - all a 'false hope', say Stanford PhDs
SEX BEAST SEALS may be egging each other on to ATTACK PENGUINS
Boffin: 'I think the behaviour is increasing in frequency'
HUMAN DNA 'will be FOUND ON MOON' – rockin' boffin Brian Cox
Crowdfund plan to stimulate Blighty's space programme
Post-pub nosh neckfiller: The MIGHTY Scotch egg
Off to the boozer? This delicacy might help mitigate the effects
I'M SO SORRY, sobs Rosetta Brit boffin in 'sexist' sexy shirt storm
'He is just being himself' says proud mum of larger-than-life physicist
NASA launches new climate model at SC14
75 days of supercomputing later ...
Britain's HUMAN DNA-strewing Moon mission rakes in £200k
3 days, and Kickstarter moves lander 37% nearer takeoff
prev story

Whitepapers

Choosing cloud Backup services
Demystify how you can address your data protection needs in your small- to medium-sized business and select the best online backup service to meet your needs.
Getting started with customer-focused identity management
Learn why identity is a fundamental requirement to digital growth, and how without it there is no way to identify and engage customers in a meaningful way.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Choosing a cloud hosting partner with confidence
Download Choosing a Cloud Hosting Provider with Confidence to learn more about cloud computing - the new opportunities and new security challenges.
Storage capacity and performance optimization at Mizuno USA
Mizuno USA turn to Tegile storage technology to solve both their SAN and backup issues.