Geekbench bans four generations of Galaxy devices for benchmark manipulation

At the end of the line : Earlier this week, users discovered that Samsung was limiting thousands of apps on its flagship Galaxy S series phones, including its latest Galaxy S22, while conveniently excluding popular benchmarking tools like Geekbench. In response, the developers behind Geekbench banned the last four generations of Samsung Galaxy devices from its services for manipulating benchmark results.

Thermal throttling on phones is nothing new. Most modern devices slow down when their processor gets dangerously hot, which helps prevent overheating and maintain battery longevity. However, following the recent launch of the Samsung Galaxy S22 series, we reported that several users on Twitter and YouTube noticed that the built-in Game Optimization Service (GOS) preemptively slows down common apps with no option to disable performance. . reduction.

This was corroborated by S22 owners on Korean social media sites and forums, who noticed apps loading slower than expected.

Despite apparently being a “game” optimization service, users have noticed that only a third of the titles on the list are games, with the rest being standard apps. There are around 10,000 apps affected, including common streaming services like Netflix and Spotify, social networking tools like TikTok, and even Samsung’s own home launcher. Standard benchmarking tools such as Geekbench, Antutu, 3DMark, and GFXBench are not on the list.

The Geekbench developers responded by prohibition Samsung’s last four generations of flagship phones from its benchmark handling comparison chart, with further research revealing that GOS has been active since the Galaxy S10.

“Earlier this week, we learned about Samsung’s Game Optimization Service (GOS) and how it throttles game and app performance. GOS decides to throttle (or not throttle) apps using app ids and not app behavior,” Geekbench tweeted. out Friday. The company added that it considers the practice “a form of benchmark manipulation.”

Geekbench points out that devices generally use the behavior to speed up, while GOS reduces performance depending on the app itself. Most benchmarks are meant to be used comparatively, giving consumers an idea of ​​how different devices stack up against each other in terms of performance. However, when a manufacturer preemptively limits common applications, these numbers can no longer accurately represent performance differences between devices.

According to The Verge, Samsung promised to release a GOS update that would allow users to directly configure app performance. “We appreciate the feedback we receive on our products and after careful consideration, we plan to roll out a software update soon so that users can monitor performance when running gaming applications,” said Kelly Yeo. from Samsung.

Geekbench’s policy prevents devices from being relisted on their services even after a patch fixes the problem, so Galaxy devices are unlikely to return to the benchmark charts any time soon.

This isn’t the first time a phone maker has attempted to manipulate benchmarks through this method. In July 2021, OnePlus was also caught throttling the performance of common apps on the OnePlus 9 and OnePlus 9 Pro. These devices were also later banned from Geekbench.



Source link