Feeds

MIT boffin's algorithm foresees Twitter's trendy future

Predicts with 95% accuracy when a small trend will burst big

High performance access to file storage

An MIT professor has developed an algorithm to predict what's going to be big on Twitter before it's big on Twitter – for those that care about such things. Twitter will care, he predicts.

Associate Professor Devavrat Shah and his student Stanislav Nikolov have created an algorithm that determines with 95% accuracy whether a topic will trend. Shah can find out up to four or five hours before Twitter lists it on their "Trending Topics". On average, he can predict whether topics such as #youknowyouredumpedwhen, #christmas, #itsfriday will trend 90 mintues before they make it onto Twitter's trending list.

It's partly to do with a pattern of "explosive growth" early on, but even that doesn't fully predict whether something goes "a step up" and hits the big time, or whether it will die off. If the pattern of growth matches that of other Twitter topics that proceeded to go big, they are weighed more heavily in the counting.

The researchers' results, reported in MIT News, are based on a survey of 400 twitter topics, of which 200 trended and 200 didn't.

Shah said that the data sort of worked out what was going to be big by itself:

Trending things ... remain small for some time and then there is a step. This is a very simplistic model. Now, based on the data, you try to train for when the jump happens, and how much of a jump happens.

The problem with this is, I don't know that things that trend have a step function. There are a thousand things that could happen. So instead [we] just let the data decide.

MIT's newsletter predicts that Twitter may be interested in the widget as it could help them sell and target advertising. ®

High performance access to file storage

More from The Register

next story
Android engineer: We DIDN'T copy Apple OR follow Samsung's orders
Veep testifies for Samsung during Apple patent trial
Windows 8.1, which you probably haven't upgraded to yet, ALREADY OBSOLETE
Pre-Update versions of new Windows version will no longer support patches
OpenSSL Heartbleed: Bloody nose for open-source bleeding hearts
Bloke behind the cockup says not enough people are helping crucial crypto project
Microsoft lobs pre-release Windows Phone 8.1 at devs who dare
App makers can load it before anyone else, but if they do they're stuck with it
Half of Twitter's 'active users' are SILENT STALKERS
Nearly 50% have NEVER tweeted a word
Windows XP still has 27 per cent market share on its deathbed
Windows 7 making some gains on XP Death Day
Internet-of-stuff startup dumps NoSQL for ... SQL?
NoSQL taste great at first but lacks proper nutrients, says startup cloud whiz
This time it's 'Personal': new Office 365 sub covers just two devices
Redmond also brings Office into Google's back yard
US taxman blows Win XP deadline, must now spend millions on custom support
Gov't IT likened to 'a Model T with a lot of things on top of it'
prev story

Whitepapers

Securing web applications made simple and scalable
In this whitepaper learn how automated security testing can provide a simple and scalable way to protect your web applications.
Five 3D headsets to be won!
We were so impressed by the Durovis Dive headset we’ve asked the company to give some away to Reg readers.
HP ArcSight ESM solution helps Finansbank
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Mobile application security study
Download this report to see the alarming realities regarding the sheer number of applications vulnerable to attack, as well as the most common and easily addressable vulnerability errors.