Feeds

IBM open sources enterprise search

Takes unstructured approach

  • alert
  • submit to reddit

Build a business case: developing custom apps

IBM is open sourcing a jointly developed search architecture with a view to creating a common industry approach to querying unstructured enterprise data.

The company is today expected to announce plans to open source the Unstructured Information Management Architecture (UIMA) used in the company's WebSphere Information Integrator OmniFind Edition, WebSphere Portal Server and Lotus Workplace. IBM is also open sourcing the UIMA toolkit.

UIMA provides a framework for software tools and services capable of conducting context-based searches across millions of unstructured records, databases, content repositories and email systems.

UIMA was developed by IBM Research with "significant" input from the Defense Advanced Research Projects Agency (DARPA), along with other contributors.

Nelson Mattos, IBM distinguished engineer and vice president of information integration, said UIMA could return hundreds of relevant documents from a search query compared to a key word search-based approach that would return millions of documents.

According to Mattos, IBM hopes to create an industry standard for text analytics through the release of the code. "The key goal is to create a forum for other research institutions to contribute to and develop the framework without having to depend purely on IBM to support it," he said.

IBM also hopes to attract buy-in from the commercial sector. As such, IBM is today also expected to announce 15 companies will use UIMA as the framework for planned search and text analysis tools.

Open sourcing UIMA is the first-step in a process that could see IBM adopt existing industry standards for use with the architecture. IBM said it would investigate use of the Object Management Group's (OMG's) Unified Modeling Language (UML), eCore, and XML Metadata Interchange (XMI) with the UIMA's Common Analysis Structure (CAS) specification later this year. CAS handles data exchange between UIMA's various components. ®

Related stories

IBM 'really committed' to Java community
IBM and Google find each other in desktop search
Search pioneers join Yahoo! - but is the web beyond search?

Gartner critical capabilities for enterprise endpoint backup

More from The Register

next story
Why has the web gone to hell? Market chaos and HUMAN NATURE
Tim Berners-Lee isn't happy, but we should be
Microsoft boots 1,500 dodgy apps from the Windows Store
DEVELOPERS! DEVELOPERS! DEVELOPERS! Naughty, misleading developers!
'Stop dissing Google or quit': OK, I quit, says Code Club co-founder
And now a message from our sponsors: 'STFU or else'
Apple promises to lift Curse of the Drained iPhone 5 Battery
Have you tried turning it off and...? Never mind, here's a replacement
Linux turns 23 and Linus Torvalds celebrates as only he can
No, not with swearing, but by controlling the release cycle
Scratched PC-dispatch patch patched, hatched in batch rematch
Windows security update fixed after triggering blue screens (and screams) of death
This is how I set about making a fortune with my own startup
Would you leave your well-paid job to chase your dream?
prev story

Whitepapers

Top 10 endpoint backup mistakes
Avoid the ten endpoint backup mistakes to ensure that your critical corporate data is protected and end user productivity is improved.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Backing up distributed data
Eliminating the redundant use of bandwidth and storage capacity and application consolidation in the modern data center.
The essential guide to IT transformation
ServiceNow discusses three IT transformations that can help CIOs automate IT services to transform IT and the enterprise
Next gen security for virtualised datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.