Feeds

Potty-mouthed Watson supercomputer needed filth filter

Urban Dictionary blew its digital mind

Build a business case: developing custom apps

IBM's Watson supercomputer was smart enough to beat two human opponents on US quiz show Jeopardy!, but there is apparently some knowledge that the system is still too immature to handle – namely, the contents of the Urban Dictionary.

Watson is perhaps the most sophisticated artificial intelligence computer system developed to date. In addition to its quiz-show triumph, it has already been put to work on a variety of real-world business scenarios, including analyzing customer data for the finance industry and helping doctors diagnose and treat patients.

Part of what makes Watson's problem-solving ability seem so uncanny is its advanced natural language processing capabilities, which allow it to understand the complexities of unstructured data. But as Fortune reports, IBM researcher Eric Brown learned that there are limits to how well Watson can interpret human communication.

In an effort to broaden the range of texts that Watson could interpret, Brown tried teaching it the Urban Dictionary, that crowdsourced compendium of words that tend to totter on the bleeding edge of modern English speech. WCGW?

Brown soon found that while Watson is fast with facts, it's none too quick to pick up on the subtleties of slang. Worse, like any schoolchild, the 6-year-old Watson was all too eager to try out the new words it had learned.

Almost immediately, Watson began casually dropping profanity into its everyday speech, such as answering one researcher's query with the less-than-scientific term "bullshit." (Although, to be fair, Watson may be sharper than the IBMers care to admit – just not particularly tactful.)

In the end, Brown and his team had to develop a filter to restrain Watson's more Tourette's-like impulses while they worked to undo the corruption that the introduction of the Urban Dictionary had caused.

Fortunately, Watson's current applications on Wall Street and in hospitals don't generally require it to know the difference between a ROFL and a WCETHBAC. But the incident does help to illustrate the fact that, as advanced as Watson may be, science is still a long way from developing a computer that can communicate as fully and richly as humans can.

"As humans, we don't realize just how ambiguous our communication is," Brown says, noting that Watson picked up a few bad habits from reading Wikipedia, too. ®

Boost IT visibility and business value

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
SHOCK and AWS: The fall of Amazon's deflationary cloud
Just as Jeff Bezos did to books and CDs, Amazon's rivals are now doing to it
VVOL update: Are any vendors NOT leaping into bed with VMware?
It's not yet been released but everyone thinks it's the dog's danglies
BlackBerry: Toss the server, mate... BES is in the CLOUD now
BlackBerry Enterprise Services takes aim at SMEs - but there's a catch
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
The Essential Guide to IT Transformation
ServiceNow discusses three IT transformations that can help CIO's automate IT services to transform IT and the enterprise.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.