Feeds

IQ test: 'Artificial intelligence system as smart as a four year-old'

Computing rug rat struggles with common sense

Build a business case: developing custom apps

Researchers at the University of Illinois at Chicago have applied an IQ test to MIT's ConceptNet 4 artificial intelligence system, and determined it's about as smart as a somewhat-challenged four-year-old child.

The team used the Weschsler Preschool and Primary Scale of Intelligence Test on the system and found it performed reasonably well on vocabulary and recognizing similarities, but scored very poorly on comprehension.

"ConceptNet 4 did dramatically worse than average on comprehension - the 'why' questions," said Robert Sloan, professor and head of computer science at UIC, and lead author on the study. "If a child had scores that varied this much, it might be a symptom that something was wrong."

ConceptNet 4 has now been replaced with a smarter AI system, ConceptNet 5, but Sloan said its predecessor's performance highlighted one of the fundamental problems with generating true artificial intelligence. Such systems are have great difficulty generating what humans call common sense, since that all-too-rare capacity requires not only an extensive amount of factual knowledge, but also subjective facts we learn in life.

"All of us know a huge number of things," said Sloan. "As babies, we crawled around and yanked on things and learned that things fall. We yanked on other things and learned that dogs and cats don't appreciate having their tails pulled."

For example, he said it's easy to build a computer that knows the freezing temperature of water, but it also has to know that ice is cold, which is a much more subjective calculation. The team is now feeding the research back into AI development with the hope of creating more efficient software that can complement (or compete with) humans.

"We're still very far from programs with common sense – AI that can answer comprehension questions with the skill of a child of eight," concludes Sloan. ®

Secure remote control for conventional and virtual desktops

More from The Register

next story
LOHAN packs bags for SPACEPORT AMERICA!
Spanish launch goes titsup, we're off to the US of A
Gigantic toothless 'DRAGONS' dominated Earth's early skies
Gummy pterosaurs outlived toothy competitors
'Leccy racer whacks petrols in Oz race
ELMOFO rakes in two wins in sanctioned race
Boffins ID freakish spine-smothered prehistoric critter: The CLAW gave it away
Bizarre-looking creature actually related to velvet worms
CRR-CRRRK, beep, beep: Mars space truck backs out of slippery sand trap
Curiosity finds new drilling target after course correction
Astronomers scramble for obs on new comet
Amateur gets fifth confirmed discovery
Boffins build CYBORG-MOTHRA but not for evil: For search & rescue
This tiny bio-bot will chew through your clothes then save your life
Vulture 2 takes a battering in 100km/h test run
Still in one piece, but we're going to need MORE POWER
What does a flashmob of 1,024 robots look like? Just like this
Sorry, Harvard, did you say kilobots or KILLER BOTS?
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Top 10 endpoint backup mistakes
Avoid the ten endpoint backup mistakes to ensure that your critical corporate data is protected and end user productivity is improved.
Top 8 considerations to enable and simplify mobility
In this whitepaper learn how to successfully add mobile capabilities simply and cost effectively.
Rethinking backup and recovery in the modern data center
Combining intelligence, operational analytics, and automation to enable efficient, data-driven IT organizations using the HP ABR approach.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.