Feeds

Most security products not up to scratch

But most of all, you've let yourself down

The Essential Guide to IT Transformation

Only four per cent (one in 25) information security products pass muster when first tested under a widely-used industry kitemark scheme.

Most products require two or more cycles of testing before achieving certification, according to security testing outfit ICSA Labs.

ICSA Labs, which has tested anti-virus and firewall products for more than 20 years, reported in the study published Monday that problems included basic failures to perform often cropped up. Across seven product categories, core product functionality shortcomings accounted for 78 per cent of initial test failures.

For example, anti-virus products often failed to prevent malware infection at the first attempt, while firewalls or IPS (intrusion prevention) products failed to make the grade in blocking attack traffic.

Shortcomings in accurately logging data was the second most common reason for security product test failures, particularly for firewalls. Security flaws introduced by the products also created a frequent source of problems, along with "random behavior that affects product availability" (ie crashes).

The ICSA Labs testing and certification process is tough, with only four per cent of products tested making the grade during the first testing cycle. However, 82 per cent of products resubmitted for testing eventually pass and earn ICSA Labs certification, a benchmark they have to match periodically to gain ongoing certification.

Taken at face value the test failings might appear damning, but the test process itself helps to push vendors towards delivering more secure products. ICSA Labs details common pitfalls to avoid and factors that contribute to testing success in its report that vendors would do well to note.

Information security technology is even more subject to the vagaries of fashion than other aspects of IT, with the possible exception of mobile phone handsets.

ICSA Labs advises end users to choose simplicity over complexity, and suggests a bias towards more established products over newer products that whose kinks are yet to be worked out. The advice runs contrary to conventional industry marketing, which would have users believe innovation is making products better-performing and more secure.

ICSA Labs Product Assurance Report covers testing across seven product categories - anti-virus, network firewall, Web application firewall, network IPS, IPSec VPN, SSL VPN and custom testing. The study, which was sponsored by Verizon Business, can be found here (PDF). ®

Build a business case: developing custom apps

More from The Register

next story
14 antivirus apps found to have security problems
Vendors just don't care, says researcher, after finding basic boo-boos in security software
Only '3% of web servers in top corps' fully fixed after Heartbleed snafu
Just slapping a patched OpenSSL on a machine ain't going to cut it, we're told
'Things' on the Internet-of-things have 25 vulnerabilities apiece
Leaking sprinklers, overheated thermostats and picked locks all online
How long is too long to wait for a security fix?
Synology finally patches OpenSSL bugs in Trevor's NAS
Israel's Iron Dome missile tech stolen by Chinese hackers
Corporate raiders Comment Crew fingered for attacks
Roll out the welcome mat to hackers and crackers
Security chap pens guide to bug bounty programs that won't fail like Yahoo!'s
HIDDEN packet sniffer spy tech in MILLIONS of iPhones, iPads – expert
Don't panic though – Apple's backdoor is not wide open to all, guru tells us
Researcher sat on critical IE bugs for THREE YEARS
VUPEN waited for Pwn2Own cash while IE's sandbox leaked
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
The Essential Guide to IT Transformation
ServiceNow discusses three IT transformations that can help CIO's automate IT services to transform IT and the enterprise.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.