Feeds

Potty-mouthed Watson supercomputer needed filth filter

Urban Dictionary blew its digital mind

Boost IT visibility and business value

IBM's Watson supercomputer was smart enough to beat two human opponents on US quiz show Jeopardy!, but there is apparently some knowledge that the system is still too immature to handle – namely, the contents of the Urban Dictionary.

Watson is perhaps the most sophisticated artificial intelligence computer system developed to date. In addition to its quiz-show triumph, it has already been put to work on a variety of real-world business scenarios, including analyzing customer data for the finance industry and helping doctors diagnose and treat patients.

Part of what makes Watson's problem-solving ability seem so uncanny is its advanced natural language processing capabilities, which allow it to understand the complexities of unstructured data. But as Fortune reports, IBM researcher Eric Brown learned that there are limits to how well Watson can interpret human communication.

In an effort to broaden the range of texts that Watson could interpret, Brown tried teaching it the Urban Dictionary, that crowdsourced compendium of words that tend to totter on the bleeding edge of modern English speech. WCGW?

Brown soon found that while Watson is fast with facts, it's none too quick to pick up on the subtleties of slang. Worse, like any schoolchild, the 6-year-old Watson was all too eager to try out the new words it had learned.

Almost immediately, Watson began casually dropping profanity into its everyday speech, such as answering one researcher's query with the less-than-scientific term "bullshit." (Although, to be fair, Watson may be sharper than the IBMers care to admit – just not particularly tactful.)

In the end, Brown and his team had to develop a filter to restrain Watson's more Tourette's-like impulses while they worked to undo the corruption that the introduction of the Urban Dictionary had caused.

Fortunately, Watson's current applications on Wall Street and in hospitals don't generally require it to know the difference between a ROFL and a WCETHBAC. But the incident does help to illustrate the fact that, as advanced as Watson may be, science is still a long way from developing a computer that can communicate as fully and richly as humans can.

"As humans, we don't realize just how ambiguous our communication is," Brown says, noting that Watson picked up a few bad habits from reading Wikipedia, too. ®

The essential guide to IT transformation

More from The Register

next story
The Return of BSOD: Does ANYONE trust Microsoft patches?
Sysadmins, you're either fighting fires or seen as incompetents now
Microsoft: Azure isn't ready for biz-critical apps … yet
Microsoft will move its own IT to the cloud to avoid $200m server bill
US regulators OK sale of IBM's x86 server biz to Lenovo
Now all that remains is for gov't offices to ban the boxes
Flash could be CHEAPER than SAS DISK? Come off it, NetApp
Stats analysis reckons we'll hit that point in just three years
Oracle reveals 32-core, 10 BEEELLION-transistor SPARC M7
New chip scales to 1024 cores, 8192 threads 64 TB RAM, at speeds over 3.6GHz
Object storage bods Exablox: RAID is dead, baby. RAID is dead
Bring your own disks to its object appliances
Nimble's latest mutants GORGE themselves on unlucky forerunners
Crossing Sandy Bridges without stopping for breath
prev story

Whitepapers

5 things you didn’t know about cloud backup
IT departments are embracing cloud backup, but there’s a lot you need to know before choosing a service provider. Learn all the critical things you need to know.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.
Rethinking backup and recovery in the modern data center
Combining intelligence, operational analytics, and automation to enable efficient, data-driven IT organizations using the HP ABR approach.
Next gen security for virtualised datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.