Remember back in July when Anand Lal Shimpi and Brian Klug at AnandTech caught Samsung cheating on benchmark tests by making the CPU on the Galaxy S4 run higher when it detected benchmark apps? That was terrible, right—but they got caught and probably wouldn’t do it again.
Now Ars Technica caught Samsung cheating on Galaxy Note 3 benchmark tests.
We noticed an odd thing while testing the Samsung Galaxy Note 3: it scores really, really well in benchmark tests—puzzlingly well, in fact. A quick comparison of its scores to the similarly specced LG G2 makes it clear that something fishy is going on, because Samsung’s 2.3GHz Snapdragon 800 blows the doors off LG’s 2.3GHz Snapdragon 800. What makes one Snapdragon so different from the other?
After a good bit of sleuthing, we can confidently say that Samsung appears to be artificially boosting the US Note 3’s benchmark scores with a special, high-power CPU mode that kicks in when the device runs a large number of popular benchmarking apps.
So what’s a company like Samsung to do when people continue to catch them cheating? Stop cheating, perhaps?
No, not Samsung. They are going to make their own benchmark tools for testers. Yeah, we’ll definitely believe the tests that come from that app.