Feeds

Competition crowdsources blisteringly-fast software

TopCoder challenge helps immune system research

SANS - Survey on application security programs

If you want a massive improvement in the software you use, the cheapest way to get it is to host a competition on TopCoder.

That seems to be at least one of the discoveries made when a group of research biologists staged a competition on the MIT-operated site. A two-week contest with regular prizes of $US500 ended up costing the researchers just $US6,000, and yielded new – and hugely efficient and effective – software for analysing immune system genes.

The real-world problem presented by the researchers was to analyse the genes involved in producing antibodies and T-cell receptors. This is definitely a non-trivial problem in genetic research. As Nature puts it:

“These genes are formed from dozens of modular DNA segments located throughout the genome, and they can be mixed and matched to yield trillions of unique proteins, each capable of recognizing a different pathogen or foreign molecule.”

With that kind of complexity, the problem is demanding on computing resources and software.

Hence the competition: the lead researcher, Eva Guinan (of the Dana-Farber Cancer Institute) and her collaborators asked TopCoder participants if they could do better: “The researchers offered TopCoder what they thought would be an impossible goal: to develop a predictive algorithm that was an order of magnitude better than either a custom solution developed by Arnaout [Ramy Arnaout of the Beth Israel Deaconess Medical Centre] or the NIH’s standard approach (MegaBLAST)”.

The result was a huge success, 84 solutions were offered by entrants in the competition, 16 of them outperforming MegaBLAST.

The best-of-the-best was 970 times faster than either MegaBLAST or Armout’s software, which should go some way towards Guinan’s perfect world in which the researcher could run this kind of analysis on their laptops instead of supercomputers.

There were 733 participants in the competition, of which 122 submitted code; 44 percent of them were software professionals, and the rest were students at various levels.

For The Register, this is a killer observation: to make the problem accessible for the competition, “they had to first reframe the problem, translating it so that it could be accessible to individuals not trained in computational biology.”

In other words, if you ask the right question, you can get the right answer – remarkably cheaply. ®

High performance access to file storage

More from The Register

next story
This time it's 'Personal': new Office 365 sub covers just two devices
Redmond also brings Office into Google's back yard
Oh no, Joe: WinPhone users already griping over 8.1 mega-update
Hang on. Which bit of Developer Preview don't you understand?
Microsoft lobs pre-release Windows Phone 8.1 at devs who dare
App makers can load it before anyone else, but if they do they're stuck with it
Half of Twitter's 'active users' are SILENT STALKERS
Nearly 50% have NEVER tweeted a word
Internet-of-stuff startup dumps NoSQL for ... SQL?
NoSQL taste great at first but lacks proper nutrients, says startup cloud whiz
IRS boss on XP migration: 'Classic fix the airplane while you're flying it attempt'
Plus: Condoleezza Rice at Dropbox 'maybe she can find ... weapons of mass destruction'
Ditch the sync, paddle in the Streem: Upstart offers syncless sharing
Upload, delete and carry on sharing afterwards?
New Facebook phone app allows you to stalk your mates
Nearby Friends feature goes live in a few weeks
Microsoft TIER SMEAR changes app prices whether devs ask or not
Some go up, some go down, Redmond goes silent
prev story

Whitepapers

Securing web applications made simple and scalable
In this whitepaper learn how automated security testing can provide a simple and scalable way to protect your web applications.
3 Big data security analytics techniques
Applying these Big Data security analytics techniques can help you make your business safer by detecting attacks early, before significant damage is done.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Top three mobile application threats
Learn about three of the top mobile application security threats facing businesses today and recommendations on how to mitigate the risk.
Combat fraud and increase customer satisfaction
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.