Feeds

IBM open sources enterprise search

Takes unstructured approach

  • alert
  • submit to reddit

New hybrid storage solutions

IBM is open sourcing a jointly developed search architecture with a view to creating a common industry approach to querying unstructured enterprise data.

The company is today expected to announce plans to open source the Unstructured Information Management Architecture (UIMA) used in the company's WebSphere Information Integrator OmniFind Edition, WebSphere Portal Server and Lotus Workplace. IBM is also open sourcing the UIMA toolkit.

UIMA provides a framework for software tools and services capable of conducting context-based searches across millions of unstructured records, databases, content repositories and email systems.

UIMA was developed by IBM Research with "significant" input from the Defense Advanced Research Projects Agency (DARPA), along with other contributors.

Nelson Mattos, IBM distinguished engineer and vice president of information integration, said UIMA could return hundreds of relevant documents from a search query compared to a key word search-based approach that would return millions of documents.

According to Mattos, IBM hopes to create an industry standard for text analytics through the release of the code. "The key goal is to create a forum for other research institutions to contribute to and develop the framework without having to depend purely on IBM to support it," he said.

IBM also hopes to attract buy-in from the commercial sector. As such, IBM is today also expected to announce 15 companies will use UIMA as the framework for planned search and text analysis tools.

Open sourcing UIMA is the first-step in a process that could see IBM adopt existing industry standards for use with the architecture. IBM said it would investigate use of the Object Management Group's (OMG's) Unified Modeling Language (UML), eCore, and XML Metadata Interchange (XMI) with the UIMA's Common Analysis Structure (CAS) specification later this year. CAS handles data exchange between UIMA's various components. ®

Related stories

IBM 'really committed' to Java community
IBM and Google find each other in desktop search
Search pioneers join Yahoo! - but is the web beyond search?

Security for virtualized datacentres

More from The Register

next story
Not appy with your Chromebook? Well now it can run Android apps
Google offers beta of tricky OS-inside-OS tech
Greater dev access to iOS 8 will put us AT RISK from HACKERS
Knocking holes in Apple's walled garden could backfire, says securo-chap
NHS grows a NoSQL backbone and rips out its Oracle Spine
Open source? In the government? Ha ha! What, wait ...?
Google extends app refund window to two hours
You now have 120 minutes to finish that game instead of 15
Intel: Hey, enterprises, drop everything and DO HADOOP
Big Data analytics projected to run on more servers than any other app
New 'Cosmos' browser surfs the net by TXT alone
No data plan? No WiFi? No worries ... except sluggish download speed
prev story

Whitepapers

Providing a secure and efficient Helpdesk
A single remote control platform for user support is be key to providing an efficient helpdesk. Retain full control over the way in which screen and keystroke data is transmitted.
Top 5 reasons to deploy VMware with Tegile
Data demand and the rise of virtualization is challenging IT teams to deliver storage performance, scalability and capacity that can keep up, while maximizing efficiency.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.
Secure remote control for conventional and virtual desktops
Balancing user privacy and privileged access, in accordance with compliance frameworks and legislation. Evaluating any potential remote control choice.