Articles about benchmarks

Kidney stones and a ruler

Hyperconverged infrastructure gets a Hyperbenchmark

The Transaction Processing Performance Council (TPC) has released a benchmark for hyperconverged infrastructure. The new TPCx-HCI benchmark is a derivative of the TCP-V benchmark for database performance on virtual machines. The Council's cooked up the benchmark after deciding hyperconverged infrastructure has sufficient …
Where the TPCx-IoT benchmark does its business

IoT gateways get a benchmark from the TPC

The Transaction Processing Performance Council (TPC) has decided the world needs a benchmark for the Internet of Things, or at least for the gateways that will do initial processing of data that things generate. The new “TPCx-IoT Benchmark” has set records before it's been used in anger: committee chair and Cisco's CTO for …
Simon Sharwood, 15 Sep 2017
yellow measuring tape - black writing

Google offers universal cloud benchmarking tool

Google is trying to establish an independent cloud benchmark, driven by a new tool called PerfKit Benchmarker. The tool's open source, but Google's not being entirely charitable: it says it created the tool because customers struggled to compare apples to apples when assessing the performance of Google's cloud and rival …
Simon Sharwood, 16 Feb 2015
X300 SSDs

What benchmarks CAN tell you about your solid-state drives

When it comes to storage, what benchmarks to use, how to configure them and how to interpret the results has been the subject of many a heated debate. Benchmarks are supposed to provide empirical data that can be used as evidence for drawing rational conclusions. Of course, if you torture data long enough it will confess to …
Trevor Pott, 2 Dec 2014

D-Wave disputes benchmark study showing sluggish quantum computer

Quantum computing device manufacturer D-Wave is disputing a recently published study that claims the Canadian firm's systems aren't reliably faster than more-conventional computing systems. On Thursday an international team of computer scientists published a widely previewed paper in Science detailing a series of benchmark …
Iain Thomson, 20 Jun 2014

Docker ported into Hadoop as benchmarks show SCREAMING FAST performance

The Hadoop community is working on patches that will bring the popular app-containerization technology Docker into the data management system, and independent benchmarks are showing the tech has a huge speedup over traditional virtualization approaches. Docker is an open source Linux containerization technology that uses …
Jack Clark, 2 May 2014

SPEC puts forward benchmark for accelerated supers

SPEC – the Standard Performance Evaluation Corporation – is pimping a new set of benchmarks it says will help HPC users get the most out of their hardware-accelerated systems. The “new benchmark suite that measures the performance of systems using hardware accelerator devices and supporting software”, SPEC ACCEL 1.0, comprises …

Dart 1.1 bullseyes JavaScript performance in latest benchmarks

Just two months after shipping the first production-ready version of Dart, its JavaScript competitor, Google has offered up a new version that it claims can output code that runs as fast or faster than the equivalent routines written in JavaScript. Dart has always been fast when running in a native VM. In fact, Dart benchmarks …
Neil McAllister, 17 Jan 2014

Samsung DENIES benchmark CHEATING, despite evidence

Samsung says that despite well-documented reports to the contrary, it is not cheating in benchmark testing of its smartphone processors. "The Galaxy Note 3 maximises its CPU/GPU frequencies when running features that demand substantial performance," Sammy told CNET UK. "This was not an attempt to exaggerate particular …
Rik Myslewski, 3 Oct 2013

Egad! Could Samsung be CHEATING in Galaxy benchmark tests?

Samsung has reportedly been cheating in benchmark tests, artificially boosting the scores of its latest and greatest system-on-chip, the Exynos 5 Octa, on those performance-ranking number generators so beloved by reviewers and product evaluators. "Oh hell Samsung, shame on you!" wrote a Beyond3D forum member in a posting on …
Rik Myslewski, 31 Jul 2013

Analyst: Tests showing Intel smartphones beating ARM were rigged

So does Intel's Atom-based Clover Trail+ platform really outperform ARM processors in smartphone benchmarks? Not so fast, says one analyst. In June, The Reg reported analyst firm ABI Research's claim that it had pitted a Lenovo K900 smartphone based on Intel's Atom Z2580 processor against a brace of devices build around ARM …
Neil McAllister, 12 Jul 2013
The Register breaking news

Google, Microsoft butt heads in browser benchmark battle

Google Chrome has finally met a web benchmark suite it can't master, and no one could be happier than the Internet Explorer team at Microsoft, which has used the occasion to suggest that the Chocolate Factory's browser is not really the speed demon it's cracked up to be. Dubbed RoboHornet, the new, open source benchmark suite …
Neil McAllister, 25 Sep 2012
The Register breaking news

Google launches Octane JavaScript benchmark suite

Always in search of new ways to show off the work they've done to improve performance of the Chrome browser, Google's Chrome team has unveiled a new JavaScript benchmark suite, called Octane. The new suite includes all of the tests that were part of the Chocolate Factory's earlier V8 Benchmark Suite but adds a new set of …
Neil McAllister, 21 Aug 2012

Behold the TPC-DS, a new weapon in the global Big Data war

There isn’t anything inherently evil about industry standard benchmarks, just as there isn’t anything inherently evil about guns. You know the saying: “Guns don’t kill people – people kill people.” (What about bullets? No, they’re not inherently evil either.) But in the hands of motivated vendors, benchmarks are weapons to be …
Dan Olds, 4 May 2012

Benchmarks are $%#&@!!

At SC11 I ran into Henry Newman, CEO of HPC consulting firm Instrumental Inc. After exchanging the usual pleasantries and deeply offensive personal insults, we got to talking about some of the recently released benchmark results – and how irrelevant most of them are to the real world. In the course of the conversation, Henry …
Dan Olds, 19 Dec 2011
channel

Symantec and Huawei snatch storage benchmark crown

Huawei Symantec has blown EMC and its nearly all-flash VNX off the SPECsfs2008 benchmark throne with a clustered NAS system without using SSDs. Spinning rust rules, OK? An OceanSpace N8500 with eight clustered processing engines scored 636,036 operations/sec on the SPECsfs2008 NFS benchmark. EMC had the previous record score …
Chris Mellor, 18 Apr 2011
arrow pointing up

Are SPEC file benchmarks broken?

Comment Recent EMC SPEC filer benchmarks have annihilated competing systems. EMC has used virtually all-flash systems to dramatically up its benchmark game, leaving disk-based rivals in the dust. Are the SPEC filer benchmarks now so unrealistic as to be worthless? If you think the question extreme just look at this pair of SPECsfs …
Chris Mellor, 10 Mar 2011

AMD's 'R600' benchmarked on web

How will AMD's upcoming ATI Radeon HD 2900 XT perform. Pretty darn quickly, it would seem, if preliminary tests posted on the web ahead of the troubled chip maker's official release date prove correct. Website DailyTech put the as-yet-unannounced GPU up against Nvidia's rival part, the GeForce 8800 GTS. The 2900 XT has 512MB …
Tony Smith, 24 Apr 2007

Create a news alert about benchmarks, or find more stories about benchmarks.

Biting the hand that feeds IT © 1998–2017