ut-sysbench-qt-gui: Compare CPU performance of different devices

johndoe

@ikoz thank you really much. I was offline for some time and did not see your post, but I will add this data to the app with the next update.

johndoe

Hello,
I moved this app from Ubuntu 16.04 to Ubuntu 20.04.
Some things changed with this and I am not sure, if the test is still consistent between versions (do to possible optimizations with 20.04 and a newer sysbench version).
I would be thankful, if some of you could install the app on a device with Ubuntu 20.04 and post the result after clicking on "Multiple Benchmarks".
Please do not switch to other apps or rotate the screen of your device while the test is running.
Should there be significant differences between OS versions, I will maybe need to consider this when working on the compare feature.
Thanks to everyone who helped me with this app and everyone who wants to help.

messayisto

@johndoe these are the results on my xiaomi mi a 2, devel, focal:

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
     1567 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
     2890 events per second

sysbench --test=memory --num-threads=4 run
Total operations: 50334961 (5028438.35 per second)
49155.24 MiB transferred (4910.58 MiB/sec)

sysbench --test=mutex --num-threads=64 run
     total time:                          8.6976s

hope that helps!

johndoe

@messayisto Yes, thank you. This helps to confirm, that the test result of the app is not comparable between different OS versions.

Just to be sure: You also did not turn the screen of your device off when the test was running?

messayisto

@johndoe No, I left the screen on, the test took only a few seconds.

johndoe

@messayisto

arubislander

@johndoe PinePhone UBports Edition on 20.04

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
      453 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
      901 events per second

sysbench --test=memory --num-threads=4 run
Total operations: 13723675 (1371392.07 per second)
13402.03 MiB transferred (1339.25 MiB/sec)

sysbench --test=mutex --num-threads=64 run
     total time:                          21.5289s

laschrocket

Samsung Galaxy s10e Exynos 9820 SM-G970F
Halium12

ubuntu-sdk-20.04

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
     1295 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
     4731 events per second

sysbench --test=memory --num-threads=4 run
Total operations: 55964278 (5595339.81 per second)
54652.62 MiB transferred (5464.20 MiB/sec)

sysbench --test=mutex --num-threads=64 run
     total time:                          3.4450s

dioginfo

Redmi Note 7

ubuntu-sdk-20.04

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1657 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
4755 events per second

sysbench --test=memory --num-threads=4 run
Total operations: 36500964 (3646830.87 per second)
35645.47 MiB transferred (3561.36 MiB/sec)

sysbench --test=mutex --num-threads=64 run
total time: 4.8477s

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1673 events per second

ikoz

Updated benchmarks for Nord 2 on 20.04
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
2492 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
4681 events per second

sysbench --test=memory --num-threads=4 run
Total operations: 104857600 (13066576.75 per second)
102400.00 MiB transferred (12760.33 MiB/sec)

sysbench --test=mutex --num-threads=64 run
total time: 2.6850s

The noteworthy changes were that memory bandwidth has increased 4x, while mutex test decreased 2x, no significant change in cpu benchmarks.

However, because there is always room for improvement, I changed the governor, ajusted niceness and increased threads (although the phone has 8 cores sysbench didn't seem to use them all), and these were the results:
2643 for 2 threads,
4833 for 8 threads,
5634 for 12 threads,
and.... 6172 for 16 threads

Maybe the latter benchmarks are not considered valid. I also have to note that benchmarks varied a little (±100) with these changes.

DJac

Result for a
Sony Xperia X f5121
Ubuntu 16.04 (ota-25)
Use the buttons bellow to start a benchmark
(the results will be displayed after the benchmark
finished, this can take some time!).
Please do not turn off your device or switch to
other apps, when running the benchmark,
this will make the results of a benchmark useless.

The results of a new benchmark will be displayed
under the results of performed benchmarks.

Example results for the CPU Benchmark of a Nexus 4:
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
57 events per second

Use the buttons below to get results
that can be used to compare
your device with other devices.

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1059 events per second

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
909 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
2684 events per second

sysbench --test=memory --num-threads=4 run
Operations performed: 104857600 (894135.77 ops/sec)
102400.00 MB transferred (873.18 MB/sec)

sysbench --test=mutex --num-threads=64 run
total time: 1.5173s

stefan_hdb

I used the test for 3 devices, here are the results:

Device BQ Aquaris M10 FHD, Ubuntu 16.04

sysbench --test=cpu --num-threads=2 --Cpu-max-prime=20000 run 59 events per second

sysbench --test=cpu --num-threads=8 --Cpu-max-prime=20000 run 113 events per second

sysbench --test=memory --num-threads=4 run Operations performed: 0 ( 0.00 ops/sec) 0.00 MB transferred (0.00 MB/sec)

sysbench --test=mutex --num-threads=64 run total time: 0.9229s

Device xperia X ubuntu-sdk-20.04

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run 1385 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run 2465 events per second

sysbench --test=memory --num-threads=4 run Total operations: 25487419 (2546616.80 per second) 24890.06 MiB transferred (2486.93 MiB/sec)

sysbench --test=mutex --num-threads=64 run total time: 9.2790s

Device: pinetab2, ubuntu-sdk-20.04

sysbench -test=cpu -num-threads=2 -cpu-max-prime=20000 run 678 events per second

sysbench -test=cpu -num-threads=8 -cpu-max-prime=20000 run 1263 events per second

sysbench -testzmemory -num-threads=4 run Total operations: 50881276 (5086734.72 per second) 4968.75 MIB transferred (4967.51 MiB/sec)

sysbench -test=mutex -num-threads=64 run total time: 15.9498s

This result is quite in line with my observations when using these devices: Xperia X performance is quite good after the update to the new release.

Kind regards, Stefan

johndoe

@dioginfo @ikoz @DJac @stefan_hdb
Thank you for the data. I will use it for the next update. But it could maybe take until next month for me to have time for it.

sven

I ran the benchmarks on a Gigaset GS5 Pro with Ubuntu 20.04 OTA-4:

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run 1650 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run 3735 events per second

sysbench --test=memory --num-threads=4 run Total Operations: 60181714 ( 6017004 per second) 58771.21 MiB transferred

sysbench --test=mutex --num-threads=64 run total time: 5.0982s

StephPTi

Here is my Poco X3 NFC on 20.04 dev

ancientsounds

OnePlus 6T:

ubuntu-sdk-20.04

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1095 events per second

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1089 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
3063 events per second

sysbench --test=memory --num-threads=4 run
Total operations: 25124442 (2511263.68 per second)
24535.59 MiB transferred (2452.41 MiB/sec)

sysbench --test=mutex --num-threads=64 run
total time: 6.2309s

Charly

Volla X23:

ubuntu-sdk-20.04

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1924 events per second

sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1927 events per second

sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
4222 events per second

sysbench --test=memory --num-threads=4 run
Total operations: 69640008 (696072.68 per second)
68007.82 MiB transferred (6799.51 MiB/sec)

sysbench --test=mutex --num-threads=64 run
total time: 4.2907s