Samsung denies benchmark cheating, despite evidence
Honorable Apple tweets umbrage at alleged chicanery
Samsung says that despite well-documented reports to the contrary, it is not cheating in benchmark testing of its smartphone processors.
"The Galaxy Note 3 maximises its CPU/GPU frequencies when running features that demand substantial performance," Sammy told CNET UK. "This was not an attempt to exaggerate particular benchmarking results."
Add to that discovery a comprehensive report by AnandTech on Wednesday that Samsung cranks up the cores for certain benchmarks on the Qualcomm Snapdragon 600 and 800 chips in its Galaxy S 4 and Galaxy Note 3, respectively, as well as the Intel Atom Z2560 in its Galaxy Tab 3 10.1 and the Exynos 5420 in its the next iteration of the Galaxy Note 10.1.
It doesn't look good for the Korean giant's veracity, does it?
"A quick comparison of its scores to the similarly specced LG G2 makes it clear that something fishy is going on," ArsTechnica writes, "because Samsung's 2.3GHz Snapdragon 800 blows the doors off LG's 2.3GHz Snapdragon 800."
And Samsung is not alone in its alleged chicanery. "With the exception of Apple and Motorola," AnandTech writes, "literally every single OEM we've worked with ships (or has shipped) at least one device that runs this silly CPU optimization." They also note that none of the Google Nexus devices they have tested indulge in what they term these "cheat/hack/festivities."
Apple marketing headman Phil Shiller took the opportunity provided by ArsTechnica's report to study to tweet his umbrage along with the URL to the Ars story:
shenanigans http://t.co/30FoQDfNw0— Philip Schiller (@pschiller) October 1, 2013
As AnandTech notes, neither Qualcomm nor Intel should be taken to task for any alleged shenanigans. "I know internally Intel is quite opposed to the practice (as I'm assuming Qualcomm is as well), making this an OEM level decision and not something advocated by the chip makers," they write.
The bad publicity that might be spread when reports of such cheating surface – an opportunity that Apple's Schiller quickly jumped on – seems not worth the risk. After all, Joe Consumer could not give a fig about AnTuTu scores, and cares not a whit about Android Vellamo numbers – another benchmark that AnandTech claims to be juiced by not only Samsung, but also Asus, LG, and HTC.
Benchmarks are for geeks. The most important thing to consumers, it appears – and one that Samsung also wants shoppers to know – is whether a smartphone is available in shiny-shiny gold. ®