Feeds

What's wrong with this pixel shader?

NVidia rocked by benchmark scandal

  • alert
  • submit to reddit

Benchmark firm Futuremark has uncovered extensive cheating by NVidia in its 3DMark03 suite.

After an initial report at ExtremeTech, Futuremark revisited the tests and discovered eight instances of cheating, which improved the performance of NVidia's Detonator FX and WHQL drivers by as much as 24.1 per cent.

But NVidia achieved this not through brilliant optimization, but by alternative means which omit graphic details: so the output, while at times similar, does not resemble what it should.

As Futuremark explains:

"The cheating described here is totally different from optimization. Optimizing the driver code to increase efficiency is a technique often used to enhance game performance and carries greater legitimacy, since the rendered image is exactly what the developer intended."

NVidia deployed a variety of cheats: introducing its own pixel shaders and vertex shaders specifically for the benchmark. The shaders improved performance at the expense of image quality.

FutureMark is revisiting some ATI benchmarks, too. ATI, which has grabbed the lead from NVidia in a ferociously competitive battle, was caught cheating before.

In 2001 ATI was discovered to sacrificed quality for frame rates in a Quake 3.0 benchmark: when Quake was renamed "Quack", the drivers produced much better output but frame rate performance fell.

NVidia withdrew from FutureMark's beta program earlier this year.®

Related Link

FutureMark's NVidia audit [750 kb PDF]

Whitepapers

A strategic approach to identity relationship management
ForgeRock commissioned Forrester to evaluate companies’ IAM practices and requirements when it comes to customer-facing scenarios versus employee-facing ones.
Storage capacity and performance optimization at Mizuno USA
Mizuno USA turn to Tegile storage technology to solve both their SAN and backup issues.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Beginner's guide to SSL certificates
De-mystify the technology involved and give you the information you need to make the best decision when considering your online security options.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.