Feeds

What's wrong with this pixel shader?

NVidia rocked by benchmark scandal

  • alert
  • submit to reddit

Benchmark firm Futuremark has uncovered extensive cheating by NVidia in its 3DMark03 suite.

After an initial report at ExtremeTech, Futuremark revisited the tests and discovered eight instances of cheating, which improved the performance of NVidia's Detonator FX and WHQL drivers by as much as 24.1 per cent.

But NVidia achieved this not through brilliant optimization, but by alternative means which omit graphic details: so the output, while at times similar, does not resemble what it should.

As Futuremark explains:

"The cheating described here is totally different from optimization. Optimizing the driver code to increase efficiency is a technique often used to enhance game performance and carries greater legitimacy, since the rendered image is exactly what the developer intended."

NVidia deployed a variety of cheats: introducing its own pixel shaders and vertex shaders specifically for the benchmark. The shaders improved performance at the expense of image quality.

FutureMark is revisiting some ATI benchmarks, too. ATI, which has grabbed the lead from NVidia in a ferociously competitive battle, was caught cheating before.

In 2001 ATI was discovered to sacrificed quality for frame rates in a Quake 3.0 benchmark: when Quake was renamed "Quack", the drivers produced much better output but frame rate performance fell.

NVidia withdrew from FutureMark's beta program earlier this year.®

Related Link

FutureMark's NVidia audit [750 kb PDF]

Whitepapers

Providing a secure and efficient Helpdesk
A single remote control platform for user support is be key to providing an efficient helpdesk. Retain full control over the way in which screen and keystroke data is transmitted.
WIN a very cool portable ZX Spectrum
Win a one-off portable Spectrum built by legendary hardware hacker Ben Heck
Storage capacity and performance optimization at Mizuno USA
Mizuno USA turn to Tegile storage technology to solve both their SAN and backup issues.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Security and trust: The backbone of doing business over the internet
Explores the current state of website security and the contributions Symantec is making to help organizations protect critical data and build trust with customers.