Feeds

IBM open sources enterprise search

Takes unstructured approach

  • alert
  • submit to reddit

Reducing security risks from open source software

IBM is open sourcing a jointly developed search architecture with a view to creating a common industry approach to querying unstructured enterprise data.

The company is today expected to announce plans to open source the Unstructured Information Management Architecture (UIMA) used in the company's WebSphere Information Integrator OmniFind Edition, WebSphere Portal Server and Lotus Workplace. IBM is also open sourcing the UIMA toolkit.

UIMA provides a framework for software tools and services capable of conducting context-based searches across millions of unstructured records, databases, content repositories and email systems.

UIMA was developed by IBM Research with "significant" input from the Defense Advanced Research Projects Agency (DARPA), along with other contributors.

Nelson Mattos, IBM distinguished engineer and vice president of information integration, said UIMA could return hundreds of relevant documents from a search query compared to a key word search-based approach that would return millions of documents.

According to Mattos, IBM hopes to create an industry standard for text analytics through the release of the code. "The key goal is to create a forum for other research institutions to contribute to and develop the framework without having to depend purely on IBM to support it," he said.

IBM also hopes to attract buy-in from the commercial sector. As such, IBM is today also expected to announce 15 companies will use UIMA as the framework for planned search and text analysis tools.

Open sourcing UIMA is the first-step in a process that could see IBM adopt existing industry standards for use with the architecture. IBM said it would investigate use of the Object Management Group's (OMG's) Unified Modeling Language (UML), eCore, and XML Metadata Interchange (XMI) with the UIMA's Common Analysis Structure (CAS) specification later this year. CAS handles data exchange between UIMA's various components. ®

Related stories

IBM 'really committed' to Java community
IBM and Google find each other in desktop search
Search pioneers join Yahoo! - but is the web beyond search?

The Power of One eBook: Top reasons to choose HP BladeSystem

More from The Register

next story
NO MORE ALL CAPS and other pleasures of Visual Studio 14
Unpicking a packed preview that breaks down ASP.NET
Apple fanbois SCREAM as update BRICKS their Macbook Airs
Ragegasm spills over as firmware upgrade kills machines
Cheer up, Nokia fans. It can start making mobes again in 18 months
The real winner of the Nokia sale is *drumroll* ... Nokia
Mozilla fixes CRITICAL security holes in Firefox, urges v31 upgrade
Misc memory hazards 'could be exploited' - and guess what, one's a Javascript vuln
Put down that Oracle database patch: It could cost $23,000 per CPU
On-by-default INMEMORY tech a boon for developers ... as long as they can afford it
Google shows off new Chrome OS look
Athena springs full-grown from Chromium project's head
Apple: We'll unleash OS X Yosemite beta on the MASSES on 24 July
Starting today, regular fanbois will be guinea pigs, it tells Reg
prev story

Whitepapers

Top three mobile application threats
Prevent sensitive data leakage over insecure channels or stolen mobile devices.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.