Feeds

Google launches Octane JavaScript benchmark suite

Shocker: Chrome leads the the pack in new tests

Top 5 reasons to deploy VMware with Tegile

Always in search of new ways to show off the work they've done to improve performance of the Chrome browser, Google's Chrome team has unveiled a new JavaScript benchmark suite, called Octane.

The new suite includes all of the tests that were part of the Chocolate Factory's earlier V8 Benchmark Suite but adds a new set of benchmarks that were created from full versions of well-known web applications and libraries.

The new tests model a variety of intensive JavaScript usage scenarios, from 2D and 3D graphics rendering to in-browser code compilation. One test also times how fast the browser can load and begin using popular JavaScript libraries, including Closure and jQuery.

"A high score in the new benchmarks directly translates to better and smoother performance in similar web applications," wrote Chrome project manager Stefano Cazzulani in a post to the official Chromium blog on Tuesday.

Google engineers say the new benchmarking methods beat those of earlier JavaScript test suites, such as Kraken and SunSpider, because they test JavaScript engines against real-world code and applications, rather than using arbitrary test cases to stress specific browser features.

"Many micro-benchmarks, such as SunSpider, were written at a time when JavaScript wasn't used as extensively as a cornerstone of large, rich web applications," explains the Octane FAQ. "Therefore they tend to not measure the performance of JavaScript Engines under the demanding JavaScript environment that a modern web appplication creates."

The Octane suite gives an individual score for each test, plus a final score that is the geometric mean of all of the individual scores. Google says that it will keep adding new tests to the suite over time, so the final scores from one version of the suite will not be directly comparable to scores from other versions.

The individual tests will never change once released, however, which means individual test scores can be compared to results from different versions of the suite.

Just for kicks, your Reg correspondent took the new suite out for a spin with a few browsers. Not surprisingly, perhaps, Google's own app beat the competition, with Chrome 21 earning a final score 8653, while Firefox 14 only scored 5790 on the same hardware. The scores were based on an average of three runs.

Benchmarking Internet Explorer proved more problematic, however. We didn't have a Windows 8 machine with comparable specs handy, and it was no surprise that the IE 10 Preview struggled to complete the suite on a Samsung Slate fondleslab, scoring only 1661.

On the other hand, IE 9 wouldn't run the suite at all. In fact, it wouldn't even render its homepage properly. Are we surprised? ®

Providing a secure and efficient Helpdesk

More from The Register

next story
Preview redux: Microsoft ships new Windows 10 build with 7,000 changes
Latest bleeding-edge bits borrow Action Center from Windows Phone
Google opens Inbox – email for people too thick to handle email
Print this article out and give it to someone tech-y if you get stuck
Microsoft promises Windows 10 will mean two-factor auth for all
Sneak peek at security features Redmond's baking into new OS
UNIX greybeards threaten Debian fork over systemd plan
'Veteran Unix Admins' fear desktop emphasis is betraying open source
Google+ goes TITSUP. But WHO knew? How long? Anyone ... Hello ...
Wobbly Gmail, Contacts, Calendar on the other hand ...
DEATH by PowerPoint: Microsoft warns of 0-day attack hidden in slides
Might put out patch in update, might chuck it out sooner
Redmond top man Satya Nadella: 'Microsoft LOVES Linux'
Open-source 'love' fairly runneth over at cloud event
prev story

Whitepapers

Cloud and hybrid-cloud data protection for VMware
Learn how quick and easy it is to configure backups and perform restores for VMware environments.
A strategic approach to identity relationship management
ForgeRock commissioned Forrester to evaluate companies’ IAM practices and requirements when it comes to customer-facing scenarios versus employee-facing ones.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Three 1TB solid state scorchers up for grabs
Big SSDs can be expensive but think big and think free because you could be the lucky winner of one of three 1TB Samsung SSD 840 EVO drives that we’re giving away worth over £300 apiece.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.