Feeds

Big Blue cloud over event processing performance

The march of the big guns

3 Big data security analytics techniques

The march of the big guns into event processing continues. Microsoft, SAS and Sybase have all got point solutions that address this space in one way or another, while it may have escaped your notice that IBM has now got two offerings in this area.

The first of these is WebSphere Front Office for Financial Markets, which is essentially a platform for combining and filtering data feeds from capital markets. In effect, it might act as a front-end to an event processing engine rather than offering such a thing directly.

Secondly, and from my point of view more interestingly, there is a now a Data Streaming Extension (DSE) for the DB2 Data Warehousing Edition. This supports real-time data feeds from, say, capital markets, directly into a DB2 data warehouse. However, the purpose of this is so that you can playback and analyse event streams rather than act upon them. That is, IBM does not yet offer the sort of static queries through data streams that is typical of the main players in this space. That said, IBM has a number of ongoing event processing projects that have yet to come to fruition, one of which will integrate streamed and persistent queries.

As an aside, very few of the people in the BI group (at least, those I met at the recent Information on Demand conference) in IBM know about the Front Office product and my guess is that very few of the people dealing with Front Office know about DSE. Tut tut!

DSE is, in fact, based on what used to be the Informix Real-time Data Loader but where that used to run at something like 30,000 transactions per second, DSE will run the hundreds of thousands of transactions per second you need for capital markets, albeit on an 8-way box, which is significantly larger than you would need with one of the pure play event processing products.

Anyway, this leads me on to the main point of this article, which is that actually being able to cater for x thousands of transactions per second. While a useful measure of performance it is not the be all and end all of event processing performance. Indeed, it is only the start.

I do not usually reference other companies' work, least of all that of vendors, but Syndera (which, incidentally, is also a provider within the capital markets sector) has recently published a white paper on event processing performance that is worth a look. It can be found here and it is not vendor specific, which is why I am prepared to recommend it.

The main point about event processing performance is that it is not just a question of the events that enter the environment. In particular, new logical events are generated within the engine - for example, if Microsoft shares go up and IBM's down, that might generate a paired event - and all of these generated events also need to be processed, along with those that are external.

In addition, of course, there are a bunch of other things that you may want to do, such as access persistent data in a data warehouse or other store, generate alerts and actions, and so on.

What Syndera's paper does is to highlight these issues and look into their implications in a way that goes beyond the simplistic approach of merely saying that you can stream transactions at such and such a speed.

Copyright © 2006, IT-Analysis.com

SANS - Survey on application security programs

More from The Register

next story
This time it's 'Personal': new Office 365 sub covers just two devices
Redmond also brings Office into Google's back yard
Oh no, Joe: WinPhone users already griping over 8.1 mega-update
Hang on. Which bit of Developer Preview don't you understand?
Microsoft lobs pre-release Windows Phone 8.1 at devs who dare
App makers can load it before anyone else, but if they do they're stuck with it
Half of Twitter's 'active users' are SILENT STALKERS
Nearly 50% have NEVER tweeted a word
Internet-of-stuff startup dumps NoSQL for ... SQL?
NoSQL taste great at first but lacks proper nutrients, says startup cloud whiz
Ditch the sync, paddle in the Streem: Upstart offers syncless sharing
Upload, delete and carry on sharing afterwards?
New Facebook phone app allows you to stalk your mates
Nearby Friends feature goes live in a few weeks
Microsoft TIER SMEAR changes app prices whether devs ask or not
Some go up, some go down, Redmond goes silent
Batten down the hatches, Ubuntu 14.04 LTS due in TWO DAYS
Admins dab straining server brows in advance of Trusty Tahr's long-term support landing
prev story

Whitepapers

SANS - Survey on application security programs
In this whitepaper learn about the state of application security programs and practices of 488 surveyed respondents, and discover how mature and effective these programs are.
Combat fraud and increase customer satisfaction
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Top three mobile application threats
Learn about three of the top mobile application security threats facing businesses today and recommendations on how to mitigate the risk.
3 Big data security analytics techniques
Applying these Big Data security analytics techniques can help you make your business safer by detecting attacks early, before significant damage is done.