Security rEsrchRs find nu way 2 spot TXT spam

Symantec boffins analyse 400,000 TXTs to develop new spam-spotting approach

Top 5 reasons to deploy VMware with Tegile

Symantec boffins reckon it's no longer enough to shield e-mail users from malicious email and that spam and phishing over SMS are now worthy of some decent defences. They've even penned a study to back up the proposition, suggesting that SMS spam could be 97 per cent detectable with a false positive rate as low as 0.02 per cent.

The researchers, from Symantec offices in the UK, Ireland and the US, have published their paper at Arxiv saying that although spam detection in SMS is harder than in e-mail, it can be done.

SMS remains popular – even in an era of over-the-top messaging platforms that want to eat the carriers' lunch by shifting their texts to the data channel – and the paper argues that various habits in SMS make spam detection a problem. They cite “lexical variants”, along with contractions, wordplay and other obfuscations as posing challenges for anyone wanting to detect malicious messages.

With better baselines, the researchers argue, including text normalisation and substring clustering, these problems could be overcome.

Working with an unnamed US carrier, Symantec was able to use a large SMS dataset to test their machine learning approaches to spam-blocking. To avoid false positives, they note, they also used “a combination of behavioural and linguistic information” to get more robust results.

The researchers had around 400,000 text messages to work with (including 300,000 spams), allowing them to test what they describe as “clustered substring tokens from a subset of 100k messages using t-distributed stochastic neighbour embeddings … string similarity functions based on matching n-grams and word co-occurrences.”

To expand the total training data set, the researchers also cleaned up 200,000 Twitter messages (removing hashtags and user mentions). Their study used two approaches: MELA (message linguistic analysis) and MPA (messaging pattern analysis).

The MELA approach showed a 0.05 per cent false positive and 9.4 per cent false negative rate, the paper says, while MPA scored a much better 0.02 per cent false positives and just 3.1 per cent false negatives. ®

Internet Security Threat Report 2014

More from The Register

next story
'Kim Kardashian snaps naked selfies with a BLACKBERRY'. *Twitterati gasps*
More alleged private, nude celeb pics appear online
Home Depot ignored staff warnings of security fail laundry list
'Just use cash', former security staffer warns friends
Hackers pop Brazil newspaper to root home routers
Step One: try default passwords. Step Two: Repeat Step One until success
UK.gov lobs another fistful of change at SME infosec nightmares
Senior Lib Dem in 'trying to be relevant' shocker. It's only taxpayers' money, after all
Spies would need SUPER POWERS to tap undersea cables
Why mess with armoured 10kV cables when land-based, and legal, snoop tools are easier?
TOR users become FBI's No.1 hacking target after legal power grab
Be afeared, me hearties, these scoundrels be spying our signals
Snowden, Dotcom, throw bombs into NZ election campaign
Claim of tapped undersea cable refuted by Kiwi PM as Kim claims extradition plot
Freenode IRC users told to change passwords after securo-breach
Miscreants probably got in, you guys know the drill by now
THREE QUARTERS of Android mobes open to web page spy bug
Metasploit module gobbles KitKat SOP slop
prev story


Secure remote control for conventional and virtual desktops
Balancing user privacy and privileged access, in accordance with compliance frameworks and legislation. Evaluating any potential remote control choice.
Intelligent flash storage arrays
Tegile Intelligent Storage Arrays with IntelliFlash helps IT boost storage utilization and effciency while delivering unmatched storage savings and performance.
WIN a very cool portable ZX Spectrum
Win a one-off portable Spectrum built by legendary hardware hacker Ben Heck
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Beginner's guide to SSL certificates
De-mystify the technology involved and give you the information you need to make the best decision when considering your online security options.