Huawei And Honor Caught Cheating On Benchmarks
When it comes to Smartphones, misleading benchmarks has become a commonplace. Last year, OnePlus and Meizu were under scrutiny for manipulating the test results of some of their devices on AnTuTu and Geekbench. Now, Huawei and Honor have been caught cheating on benchmarks. And as a result, some of their handsets have been delisted from some prominent benchmarking platforms like UL Benchmarks, Futuremark and 3DMark. For now, devices removed are Huawei P20 Pro, Nova 3, and Honor Play. The news generated some flak on twitter.
It is an INCREDIBLY big deal that @HuaweiMobile has had some of its devices delisted from a respected and trusted benchmark group like UL/Futuremark with 3DMark. The P20 Pro, Nova 3, and Honor Play results are removed.
— Ryan Shrout (@ryanshrout) September 6, 2018
People generally turn to relevant benchmarks before buying a smartphone. After this quagmire, it is safe to say that benchmarks are not the only platforms one should rely on. The incident came into light after some people from Anandtech detected some disparity after testing Huawei and Honor flagships. The tests revealed that Huawei P20 and P20 Pro do not live up to the benchmark and actually scored low in graphics as compared with the predecessor Huawei Mate 10. That too notwithstanding the fact that the smartphones have the same SoC (the octa-core Kirin 970). After running another test, they noticed the same deception with the Honor Play. These tests are a salient proof of the fact that these companies tweak their results to show exaggerated results.
In a statement to AndroidAuthority the company has stated :
In normal benchmarking scenarios, once Huawei’s software recognizes a benchmarking application, it intelligently adapts to “Performance Mode” and delivers optimum performance.