Articles about benchmark

A broken camera

Good luck, have fun: Thanks Xeon SP, now SPEC benchmarks blurt out hundreds of results

Comment Ah, the good old days of server benchmarks, when CPU variations were few and clock rates ruled the roost. Now we have four different Xeon SP CPU families, one with two model lines, and each family has its own set of CPUs with differing core counts, threads and clock rates. Vendors put these in either blade or rackmount servers …
Chris Mellor, 19 Feb 2018
Shutterstock Rocket Snail

Bad benchmarks bedevil boffins' infosec efforts

A group of operating systems specialists has said that sloppy benchmarking is harming security efforts by making it hard to assess the likely performance impact of security countermeasures. The researchers from the Netherlands and Australia, decided to take a look at the accuracy of security researchers' systems benchmark. As …
Benchmark concept Illustration

Transaction Processing Performance Council to deliver AI benchmark

The Transaction Processing Performance Council has decided the world needs a benchmark for systems running artificial intelligence workloads. Raghunath Nambiar, chairman of Council's (TPC's) TPC-AI Working Group told The Register that interest in AI means users need the kind of comparison tools in which the organisation …
Simon Sharwood, 13 Dec 2017
Kidney stones and a ruler

Hyperconverged infrastructure gets a Hyperbenchmark

The Transaction Processing Performance Council (TPC) has released a benchmark for hyperconverged infrastructure. The new TPCx-HCI benchmark is a derivative of the TCP-V benchmark for database performance on virtual machines. The Council's cooked up the benchmark after deciding hyperconverged infrastructure has sufficient …

IETF doc seeks reliable vSwitch benchmark

If you fancy wrapping your mind around the complexities that make virtual switches (vSwitches) hard to benchmark, an IETF informational RFC is worth a read. Put together by Maryam Tahhan and Billy O'Mahony of Intel (note the usual disclaimer that RFCs are the work of individuals not employers) and Al Morton of AT&T, RFC 8204 …
Where the TPCx-IoT benchmark does its business

IoT gateways get a benchmark from the TPC

The Transaction Processing Performance Council (TPC) has decided the world needs a benchmark for the Internet of Things, or at least for the gateways that will do initial processing of data that things generate. The new “TPCx-IoT Benchmark” has set records before it's been used in anger: committee chair and Cisco's CTO for …
Simon Sharwood, 15 Sep 2017

HPC kids battle each other... oh, and tussle with the world's fastest supercomputer

HPC Blog This year's edition of the Asian Student Cluster Competition (ASC) is the largest competition of its kind in the world, with 20 teams of university undergrads battling each other, themselves, and the world’s fastest supercomputer, Sunway TaihuLight, to win the Asian Cluster Crown*. But more than just bragging rights are at …
Dan Olds, 24 Apr 2017
Woman serves at beginning of tennis game. Photo by Shutterstock

Nvidia says Google's TPU benchmark compared wrong kit

It's not easy being Nvidia: the rise of AI has put a rocket under demand for GPUs, but the corollary to that is World+Dog publishing benchmarks to try and knock Nvidia off its perch. The company is famously touchy about such things – witness last year's spat with Intel over benchmarks it didn't regard as fair. Well, it's …

The TPC-C/SPC-1 storage benchmarks are screwed. You know what we need?

Comment The storage benchmarking world is broken because there are no realistic and pratical storage benchmarks with realistic workloads customers can apply to systems. So says storage analyst Howard Marks, and he aims to fix this mess with the help of a consortium of industry players. He says the world of storage …
Chris Mellor, 23 Aug 2016
A boffin

Cisco, MapR first to top Big Data TPC benchmark tree

Cisco and MapR have posted the first Big Data TPCx-HS benchmark, but, of course, there's nothing to actually compare it with yet. The TPC Express HS (TPCx-HS) benchmark result was based on clustered Cisco UCS servers running Red Hat Linux and MapR Hadoop. TPC is the Transaction Processing Council, which helps produce …
Chris Mellor, 5 Mar 2015
yellow measuring tape - black writing

Google offers universal cloud benchmarking tool

Google is trying to establish an independent cloud benchmark, driven by a new tool called PerfKit Benchmarker. The tool's open source, but Google's not being entirely charitable: it says it created the tool because customers struggled to compare apples to apples when assessing the performance of Google's cloud and rival …
Simon Sharwood, 16 Feb 2015
X300 SSDs

What benchmarks can tell you about your solid-state drives

When it comes to storage, what benchmarks to use, how to configure them and how to interpret the results has been the subject of many a heated debate. Benchmarks are supposed to provide empirical data that can be used as evidence for drawing rational conclusions. Of course, if you torture data long enough it will confess to …
Trevor Pott, 2 Dec 2014

D-Wave disputes benchmark study showing sluggish quantum computer

Quantum computing device manufacturer D-Wave is disputing a recently published study that claims the Canadian firm's systems aren't reliably faster than more-conventional computing systems. On Thursday an international team of computer scientists published a widely previewed paper in Science detailing a series of benchmark …
Iain Thomson, 20 Jun 2014

Docker ported into Hadoop as benchmarks show screaming fast performance

The Hadoop community is working on patches that will bring the popular app-containerization technology Docker into the data management system, and independent benchmarks are showing the tech has a huge speedup over traditional virtualization approaches. Docker is an open source Linux containerization technology that uses …
Jack Clark, 2 May 2014

SPEC puts forward benchmark for accelerated supers

SPEC – the Standard Performance Evaluation Corporation – is pimping a new set of benchmarks it says will help HPC users get the most out of their hardware-accelerated systems. The “new benchmark suite that measures the performance of systems using hardware accelerator devices and supporting software”, SPEC ACCEL 1.0, comprises …

Dart 1.1 bullseyes JavaScript performance in latest benchmarks

Just two months after shipping the first production-ready version of Dart, its JavaScript competitor, Google has offered up a new version that it claims can output code that runs as fast or faster than the equivalent routines written in JavaScript. Dart has always been fast when running in a native VM. In fact, Dart benchmarks …
Neil McAllister, 17 Jan 2014
management cloud7

Dropbox is most pleasurable storage cloud for the old in-out

Boffins from the University of Twente and the Politecnico Di Torino have run the rule over five consumer-grade cloud storage services to see which performs best in terms of the load they impose on machines running them. While the researchers consider the five services they tested – Dropbox, SkyDrive, Google Drive, Amazon Cloud …
Simon Sharwood, 27 Nov 2013
fingerprint

Samsung denies benchmark cheating, despite evidence

Samsung says that despite well-documented reports to the contrary, it is not cheating in benchmark testing of its smartphone processors. "The Galaxy Note 3 maximises its CPU/GPU frequencies when running features that demand substantial performance," Sammy told CNET UK. "This was not an attempt to exaggerate particular …
Rik Myslewski, 3 Oct 2013

Create a news alert about benchmark, or find more stories about benchmark.

Biting the hand that feeds IT © 1998–2018