Feeds

Digging into the future of data mining

Crystal ball gazing

Reducing security risks from open source software

Comment The first thing to appreciate about data mining is that it should be thought of as R&D. That is, you do a bunch of research, some of which (but by no means all) is then deployable in the business. Moreover, some of it becomes so well established that it becomes a mass market product. For example, market basket analysis (which products have relationships to others) was once regarded as being as esoteric as anything else in data mining but is now so mainstream that it is embedded in all sorts of other environments. This is a trend that will continue, with techniques moving out of data mining R&D and into conventional deployment.

Historically, this move out of data mining has been to call centres, CRM, fraud and other standard applications. However, as complex event processing (CEP) engines take greater market share then we are likely to see increasing synergy with data mining. After all, CEP is essentially about identifying patterns and then detecting anomalies, which is exactly what data mining does.

There is a lot of hype about predictive analytics as opposed to data mining. If we take the case of market basket analysis, this is essentially saying that once we have identified that the sale of nappies is associated with beer sales (even if that is an urban myth) then we can make predictions about one based on the other. Useful, and certainly an increasing focus, but not really significantly different from what data mining has always been about.

Of course, there is also a trend to make data mining easier (and less costly) to do, but that is hardly surprising: it is common across the whole IT sector.

In my view, perhaps the most important trend is towards the integration of text mining and data mining. As yet, this is a relatively immature market but the fact is that most information held within business today is in unstructured format. While most of the discussion has been about Search that is simply about finding things related to a particular topic, while text mining is about finding patterns of information within text which, in the right context, is much more valuable. Moreover, with the advent of DB2 Viper we are likely to see the increased use of applications that employ both relational and XML-based information, in which case a combination of data and text mining makes sense.

While SPSS is one of the two major players in the data mining market it is the clear leader in the text mining space, not least because it is the dominant provider of market research software, and doing text mining on the back of the results of market research makes obvious sense. However, it is probably also the leading provider of combined text and data mining outside of this environment as well, so if I am right about the future of data mining, and its increased use with text capabilities, then SPSS is very well-placed.

SPSS is also in a good position because IBM has withdrawn the client component of its Intelligent Miner product and users thereof will be looking for a replacement offering, and SPSS has a much closer relationship with IBM than its major competitors, which it is looking to capitalise upon by picking up these users.

Copyright © 2006, IT-Analysis.com

The Power of One eBook: Top reasons to choose HP BladeSystem

More from The Register

next story
NO MORE ALL CAPS and other pleasures of Visual Studio 14
Unpicking a packed preview that breaks down ASP.NET
Captain Kirk sets phaser to SLAUGHTER after trying new Facebook app
William Shatner less-than-impressed by Zuck's celebrity-only app
Apple fanbois SCREAM as update BRICKS their Macbook Airs
Ragegasm spills over as firmware upgrade kills machines
Cheer up, Nokia fans. It can start making mobes again in 18 months
The real winner of the Nokia sale is *drumroll* ... Nokia
Mozilla fixes CRITICAL security holes in Firefox, urges v31 upgrade
Misc memory hazards 'could be exploited' - and guess what, one's a Javascript vuln
Put down that Oracle database patch: It could cost $23,000 per CPU
On-by-default INMEMORY tech a boon for developers ... as long as they can afford it
Google shows off new Chrome OS look
Athena springs full-grown from Chromium project's head
prev story

Whitepapers

Top three mobile application threats
Prevent sensitive data leakage over insecure channels or stolen mobile devices.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.