Feeds

Google launches Octane JavaScript benchmark suite

Shocker: Chrome leads the the pack in new tests

Business security measures using SSL

Always in search of new ways to show off the work they've done to improve performance of the Chrome browser, Google's Chrome team has unveiled a new JavaScript benchmark suite, called Octane.

The new suite includes all of the tests that were part of the Chocolate Factory's earlier V8 Benchmark Suite but adds a new set of benchmarks that were created from full versions of well-known web applications and libraries.

The new tests model a variety of intensive JavaScript usage scenarios, from 2D and 3D graphics rendering to in-browser code compilation. One test also times how fast the browser can load and begin using popular JavaScript libraries, including Closure and jQuery.

"A high score in the new benchmarks directly translates to better and smoother performance in similar web applications," wrote Chrome project manager Stefano Cazzulani in a post to the official Chromium blog on Tuesday.

Google engineers say the new benchmarking methods beat those of earlier JavaScript test suites, such as Kraken and SunSpider, because they test JavaScript engines against real-world code and applications, rather than using arbitrary test cases to stress specific browser features.

"Many micro-benchmarks, such as SunSpider, were written at a time when JavaScript wasn't used as extensively as a cornerstone of large, rich web applications," explains the Octane FAQ. "Therefore they tend to not measure the performance of JavaScript Engines under the demanding JavaScript environment that a modern web appplication creates."

The Octane suite gives an individual score for each test, plus a final score that is the geometric mean of all of the individual scores. Google says that it will keep adding new tests to the suite over time, so the final scores from one version of the suite will not be directly comparable to scores from other versions.

The individual tests will never change once released, however, which means individual test scores can be compared to results from different versions of the suite.

Just for kicks, your Reg correspondent took the new suite out for a spin with a few browsers. Not surprisingly, perhaps, Google's own app beat the competition, with Chrome 21 earning a final score 8653, while Firefox 14 only scored 5790 on the same hardware. The scores were based on an average of three runs.

Benchmarking Internet Explorer proved more problematic, however. We didn't have a Windows 8 machine with comparable specs handy, and it was no surprise that the IE 10 Preview struggled to complete the suite on a Samsung Slate fondleslab, scoring only 1661.

On the other hand, IE 9 wouldn't run the suite at all. In fact, it wouldn't even render its homepage properly. Are we surprised? ®

New hybrid storage solutions

More from The Register

next story
'Windows 9' LEAK: Microsoft's playing catchup with Linux
Multiple desktops and live tiles in restored Start button star in new vids
Not appy with your Chromebook? Well now it can run Android apps
Google offers beta of tricky OS-inside-OS tech
New 'Cosmos' browser surfs the net by TXT alone
No data plan? No WiFi? No worries ... except sluggish download speed
iOS 8 release: WebGL now runs everywhere. Hurrah for 3D graphics!
HTML 5's pretty neat ... when your browser supports it
Greater dev access to iOS 8 will put us AT RISK from HACKERS
Knocking holes in Apple's walled garden could backfire, says securo-chap
NHS grows a NoSQL backbone and rips out its Oracle Spine
Open source? In the government? Ha ha! What, wait ...?
Google extends app refund window to two hours
You now have 120 minutes to finish that game instead of 15
Intel: Hey, enterprises, drop everything and DO HADOOP
Big Data analytics projected to run on more servers than any other app
SUSE Linux owner Attachmate gobbled by Micro Focus for $2.3bn
Merger will lead to mainframe and COBOL powerhouse
prev story

Whitepapers

Providing a secure and efficient Helpdesk
A single remote control platform for user support is be key to providing an efficient helpdesk. Retain full control over the way in which screen and keystroke data is transmitted.
WIN a very cool portable ZX Spectrum
Win a one-off portable Spectrum built by legendary hardware hacker Ben Heck
Storage capacity and performance optimization at Mizuno USA
Mizuno USA turn to Tegile storage technology to solve both their SAN and backup issues.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Security and trust: The backbone of doing business over the internet
Explores the current state of website security and the contributions Symantec is making to help organizations protect critical data and build trust with customers.