The Register® — Biting the hand that feeds IT

Feeds

False positives run amok in Vista anti-virus tests

Generic faults

Supercharge your infrastructure

The first independent tests of anti-malware products on 64-bit Windows Vista revealed a rash of false positives.

Of the 20 products submitted for testing to independent security certification body Virus Bulletin, six generated false positives when scanning a set of known clean files.

As a result, the product failed to earn VB100 certification, a prized accolade in the anti-virus industry. The tests were the first carried out by Virus Bulletin on 64-bit Windows Vista anti-virus and anti-spyware packages.

Trend Micro submitted three of its anti-virus products, all of which falsely identified a Microsoft development tool as spyware. Other products to generate false positives were Fortinet's FortiClient, Ikarus Utilities, and VirusBuster, from the Hungarian firm of the same name.

John Hawes, technical consultant at Virus Bulletin, said: "The items added to our set of known clean files this month mostly consisted of common items taken from the 'most-popular' lists of free download sites, so it is a concern that the additions have caused such an upsurge in false detections.

"A false positive can cause as much disruption as a virus infection. False warnings often lead end-users to delete valid files in the belief that they are some form of attack and the resultant damage can be significant," he added.

Hawes blamed increased reliance on heuristic (generic) detection techniques for the rash of false alarms. "Anti-malware vendors must work hard to minimise false detections."

Other factors might also be in play.

Some anti-virus vendors complained of lack of access to the PatchGuard kernel protection system, as well as other security measures, included in the 64-bit version of Vista prior to its release. Opinions over the issue - even within the anti-virus industry - were sharply split.

Virus Bulletin reckons poor results of tests from anti-malware products on 64-bit versions of Vista suggest Microsoft's efforts at locking down the operating system have made life tougher for security firms.

Microsoft's enterprise anti-malware technology Forefront put in a strong performance and was awarded VB100 status for Vista x64 in the latest tests. By contrast, OneCare, its consumer anti-virus product, received a good shoeing after flunking Virus Bulletin's tests on 32-bit Vista products earlier this year.

Testing times

Virus Bulletin's VB100 test pit submitted anti-virus products against a test set of viruses from the WildList, a publicly available list of viruses known to be in circulation. To earn VB100 certification, products must be able to detect 100 per cent of the malware samples contained in the WildList test set while avoiding any false alarms in scanning a set of clean files.

Unlike other certification schemes, Virus Bulletin tests all products free of charge and does not allow re-testing. Virus Bulletin's comparative reviews also cover other performance aspects including detection rates against a selection of viruses never seen outside the lab of anti-virus vendors as well as looking at scanning speeds and performance overheads for anti-malware products.

The results of the VB100 certification of products for Windows Vista x64 Business Edition can be found here (free registration required). Detailed results tables are available to Virus Bulletin subscribers. ®

5 ways to prepare your advertising infrastructure for disaster

Whitepapers

5 ways to prepare your advertising infrastructure for disaster
Being prepared allows your brand to greatly improve your advertising infrastructure performance and reliability that, in the end, will boost confidence in your brand.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Email delivery: Hate phishing emails? You'll love DMARC
DMARC has been created as a standard to help properly authenticate your sends and monitor and report phishers that are trying to send from your name..
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Email delivery: 4 steps to get more email to the inbox
This whitepaper lists some steps and information that will give you the best opportunity to achieve an amazing sender reputation.

More from The Register

next story
Chaos Computer Club: iPhone 5S finger-sniffer COMPROMISED
Anyone can touch your phone and make it give up its all
Hundreds of hackers sought for new £500m UK cyber-bomber strike force
Britain must rm -rf its enemies or be rm -rf'ed, declares defence secretary
NSA in new SHOCK 'can see public data' SCANDAL!
What you say on Twitter doesn't stay on Twitter
UK's Get Safe Online? 'No one cares' - run the blockbuster ads instead
Something like Jack Bauer's 24 ... whatever it'll take to teach kids how to bat away hackers
Sweet murmuring Siri opens stalker vulnerability hole in iOS 7
'Siri, hand over my contacts and history now…'
Facebook allows full personal data ransack with Graph Search
Posts, updates, the lot. Our ad sales will boom. Mwu-ha-haaaa ... bitch
London schoolboy cuffed for BIGGEST DDOS ATTACK IN HISTORY
Bet his parents wish he'd been playing computer games
GCHQ's CESG CCP 4 UK GOV IT BFFs? LOL RTFA INFOSEC VIPs ASAP
Yet another security certificate fiddled with by Brit spooks
prev story