Feeds

IQ test: 'Artificial intelligence system as smart as a four year-old'

Computing rug rat struggles with common sense

High performance access to file storage

Researchers at the University of Illinois at Chicago have applied an IQ test to MIT's ConceptNet 4 artificial intelligence system, and determined it's about as smart as a somewhat-challenged four-year-old child.

The team used the Weschsler Preschool and Primary Scale of Intelligence Test on the system and found it performed reasonably well on vocabulary and recognizing similarities, but scored very poorly on comprehension.

"ConceptNet 4 did dramatically worse than average on comprehension - the 'why' questions," said Robert Sloan, professor and head of computer science at UIC, and lead author on the study. "If a child had scores that varied this much, it might be a symptom that something was wrong."

ConceptNet 4 has now been replaced with a smarter AI system, ConceptNet 5, but Sloan said its predecessor's performance highlighted one of the fundamental problems with generating true artificial intelligence. Such systems are have great difficulty generating what humans call common sense, since that all-too-rare capacity requires not only an extensive amount of factual knowledge, but also subjective facts we learn in life.

"All of us know a huge number of things," said Sloan. "As babies, we crawled around and yanked on things and learned that things fall. We yanked on other things and learned that dogs and cats don't appreciate having their tails pulled."

For example, he said it's easy to build a computer that knows the freezing temperature of water, but it also has to know that ice is cold, which is a much more subjective calculation. The team is now feeding the research back into AI development with the hope of creating more efficient software that can complement (or compete with) humans.

"We're still very far from programs with common sense – AI that can answer comprehension questions with the skill of a child of eight," concludes Sloan. ®

High performance access to file storage

More from The Register

next story
Fancy joining Reg hack on quid-a-day challenge?
Recruiting now for charity starvation diet
Red-faced LOHAN team 'fesses up in blown SPEARS fuse fiasco
Standing in the corner, big pointy 'D' hats
KILLER SPONGES menacing California coastline
Surfers are safe, crustaceans less so
Opportunity selfie: Martian winds have given the spunky ol' rover a spring cleaning
Power levels up 70 per cent as the rover keeps on truckin'
Discovery time for 200m WONDER MATERIALS shaved from 4 MILLENNIA... to 4 years
Alloy, Alloy: Boffins in speed-classification breakthrough
Elon Musk's LEAKY THRUSTER gas stalls Space Station supply run
Helium seeps from Falcon 9 first stage, delays new legs for NASA robonaut
Top Secret US payload launched into space successfully
Clandestine NRO spacecraft sets off on its unknown mission
prev story

Whitepapers

Top three mobile application threats
Learn about three of the top mobile application security threats facing businesses today and recommendations on how to mitigate the risk.
Combat fraud and increase customer satisfaction
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Five 3D headsets to be won!
We were so impressed by the Durovis Dive headset we’ve asked the company to give some away to Reg readers.
SANS - Survey on application security programs
In this whitepaper learn about the state of application security programs and practices of 488 surveyed respondents, and discover how mature and effective these programs are.