ut-sysbench-qt-gui: Compare CPU performance of different devices
-
@johndoe
Xiaomi mi A2 results:sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1717 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
4915 events per secondsysbench --test=memory --num-threads=4 run
Operations performed: 104857600 (6280574.81 ops/sec)
102400.00 MB transferred (6133.37 MB/sec)sysbench --test=mutex --num-threads=64 run
total time: 1.1919ssysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1706 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
5307 events per secondsysbench --test=memory --num-threads=4 run
Operations performed: 104857600 (6196075.77 ops/sec)
102400.00 MB transferred (6050.86 MB/sec)sysbench --test=mutex --num-threads=64 run
total time: 1.1151ssysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1705 events per secondsysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1706 events per second -
@yoni thank you
-
@johndoe
New version works perfectly on another Cosmo Communicator and another PinePhone.
New export and compare function works flawlessly on both.
Copy and paste results works on Cosmo, if only I could figure out how to Ctrl+V on the PinePhone touchscreen .
Really nice looking app. From my very basic understanding of the numbers I would say the app accurately reflects my experience on the two devices I have in their current state of play.Cosmo Communicator
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1652 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
5287 events per secondsysbench --test=memory --num-threads=4 run
Operations performed: 104857600 (2469862.22 ops/sec)
102400.00 MB transferred (2411.97 MB/sec)sysbench --test=mutex --num-threads=64 run
total time: 1.2297sPinePhone
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
623 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
1201 events per secondsysbench --test=memory --num-threads=4 run
Operations performed: 104857600 (932315.64 ops/sec)
102400.00 MB transferred (910.46 MB/sec)sysbench --test=mutex --num-threads=64 run
total time: 1.1598s -
@moncon Thanks, I think you can touch and hold a text field and then tap "Paste" to paste the text, that you have in the clipboard (but I see that you somehow managed to get the data of the Pinephone into your comment). It is good to see that the results are overall consistent with other phones from the same model.
-
@johndoe said in ut-sysbench-qt-gui: Compare CPU performance of different devices:
Hello,
I wrote an app to compare the performance of different devices and released it on the OpenStore: https://open-store.io/app/ut-sysbench-qt-gui
I hope the arm64 version works, because I can only test the armhf version.
It would be nice, if some of you could share your device's name together with the results you get, after clicking on "Multiple Benchmarks".
"Export and Compare" will copy the results to your clipboard and show you a bar chart with the performace of other devices.Multiple results from different persons for the same model are also useful.
You are also free to share problems with my app. I know that the memory (RAM) test does not work on all devices.
----------------------------------------------------------------------------------------
Results of my LG Nexus 4 with Ubuntu 16.04 OTA-19:sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
57 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
113 events per secondsysbench --test=memory --num-threads=4 run
Operations performed: 0 ( 0.00 ops/sec)
0.00 MB transferred (0.00 MB/sec)sysbench --test=mutex --num-threads=64 run
total time: 2.4057sNice!
Would it be possible to compile the user results into some kind of diagram/table which allows to easily compare device performance?
-
@s710 @s710 When you click on the button "Export and Compare", you should see a diagram that compares your device with other devices and the test results of your device will also be saved to your clipboard. If you want to export the shown diagram, you could take a screenshot (pressing power up and down at the same time or hold the power button and select "Screenshot" in the Lomiri power menu). You will also find what is shown in the app under:
~/.cache/ut-sysbench-qt-gui/messages/temp_message.txtThe text file under "~/.cache/ut-sysbench-qt-gui/messages/temp_message.txt" should look something like this after you performed a CPU test and clicked on "Export and Compare":
The results of the performed tests have been copied to your clipboard π (you can paste it into text fields of other apps or websites). Comparison CPU Benchmark (2 threads): Xiaomi Mi A2 | 1717 events/second ...βββββββββββββββββββββββββ Cosmo Commun. | 1652 events/second ...ββββββββββββββββββββββββ M10 Tab + 2.gen | 1235 events/second ...ββββββββββββββββββ Volla Phone | 1091 events/second ...ββββββββββββββββ Xperia X | 1035 events/second ...βββββββββββββββ Pixel 3a | 918 events/second ...βββββββββββββ Pinephone | 620 events/second ...βββββββββ Librem 5 (PureOS) | 596 events/second ...ββββββββ Nexus 5 | 58 events/second ...β Nexus 4 | 57 events/second ...β This device | 57 events/second ...β Meizu MX4 | 52 events/second ...β bq E5 | 46 events/second ...β Comparison CPU Benchmark (8 threads): Cosmo Commun. | 5287 events/second ...βββββββββββββββββββββββββ Xiaomi Mi A2 | 4915 events/second ...βββββββββββββββββββββββ M10 Tab + 2.gen | 4005 events/second ...βββββββββββββββββββ Pixel 3a | 3973 events/second ...ββββββββββββββββββ Volla Phone | 3788 events/second ...ββββββββββββββββββ Xperia X | 2467 events/second ...βββββββββββ Librem 5 (PureOS) | 1191 events/second ...ββββββ Pinephone | 1190 events/second ...ββββββ Meizu MX4 | 146 events/second ...β Nexus 4 | 113 events/second ...β Nexus 5 | 96 events/second ...β bq E5 | 91 events/second ...β Comparison Memory Benchmark (no armhf devices): Xiaomi Mi A2 | 5849 MiB/second ...βββββββββββββββββββββββββ Librem 5 (PureOS) | 5511 MiB/second ...βββββββββββββββββββββββ Pixel 3a | 2560 MiB/second ...βββββββββββββββββββββββ M10 Tab + 2.gen | 2443 MiB/second ...ββββββββ Cosmo Commun. | 2300 MiB/second ...ββββββββ Volla Phone | 2250 MiB/second ...βββββββ Pinephone | 815 MiB/second ...β Xperia X | 795 MiB/second ...β Comparison Mutex Benchmark (less time is better): Librem 5 (PureOS) | 16.1842 seconds ...βββββββββββββββββββββββββ Meizu MX4 | 3.8107 seconds ...βββββ Nexus 5 | 2.7758 seconds ...βββ Nexus 4 | 2.4609 seconds ...βββ bq E5 | 2.4057 seconds ...βββ Volla Phone | 1.8590 seconds ...ββ M10 Tab + 2.gen | 1.8361 seconds ...ββ Xperia X | 1.6159 seconds ...ββ Cosmo Commun. | 1.2297 seconds ...β Xiaomi Mi A2 | 1.1919 seconds ...β Pinephone | 1.0368 seconds ...β Pixel 3a | 0.9193 seconds ...β The shown benchmarks only give a rough idea about a device's performance and do not fully represent the everyday performance of a device.
-
@johndoe said in ut-sysbench-qt-gui: Compare CPU performance of different devices:
@s710 @s710 When you click on the button "Export and Compare", you should see a diagram that compares your device with other devices and the test results of your device will also be saved to your clipboard. If you want to export the shown diagram, you could take a screenshot (pressing power up and down at the same time or hold the power button and select "Screenshot" in the Lomiri power menu). You will also find what is shown in the app under:
~/.cache/ut-sysbench-qt-gui/messages/temp_message.txtThe text file under "~/.cache/ut-sysbench-qt-gui/messages/temp_message.txt" should look something like this after you performed a CPU test and clicked on "Export and Compare":
The results of the performed tests have been copied to your clipboard π (you can paste it into text fields of other apps or websites). Comparison CPU Benchmark (2 threads): Xiaomi Mi A2 | 1717 events/second ...βββββββββββββββββββββββββ Cosmo Commun. | 1652 events/second ...ββββββββββββββββββββββββ M10 Tab + 2.gen | 1235 events/second ...ββββββββββββββββββ Volla Phone | 1091 events/second ...ββββββββββββββββ Xperia X | 1035 events/second ...βββββββββββββββ Pixel 3a | 918 events/second ...βββββββββββββ Pinephone | 620 events/second ...βββββββββ Librem 5 (PureOS) | 596 events/second ...ββββββββ Nexus 5 | 58 events/second ...β Nexus 4 | 57 events/second ...β This device | 57 events/second ...β Meizu MX4 | 52 events/second ...β bq E5 | 46 events/second ...β Comparison CPU Benchmark (8 threads): Cosmo Commun. | 5287 events/second ...βββββββββββββββββββββββββ Xiaomi Mi A2 | 4915 events/second ...βββββββββββββββββββββββ M10 Tab + 2.gen | 4005 events/second ...βββββββββββββββββββ Pixel 3a | 3973 events/second ...ββββββββββββββββββ Volla Phone | 3788 events/second ...ββββββββββββββββββ Xperia X | 2467 events/second ...βββββββββββ Librem 5 (PureOS) | 1191 events/second ...ββββββ Pinephone | 1190 events/second ...ββββββ Meizu MX4 | 146 events/second ...β Nexus 4 | 113 events/second ...β Nexus 5 | 96 events/second ...β bq E5 | 91 events/second ...β Comparison Memory Benchmark (no armhf devices): Xiaomi Mi A2 | 5849 MiB/second ...βββββββββββββββββββββββββ Librem 5 (PureOS) | 5511 MiB/second ...βββββββββββββββββββββββ Pixel 3a | 2560 MiB/second ...βββββββββββββββββββββββ M10 Tab + 2.gen | 2443 MiB/second ...ββββββββ Cosmo Commun. | 2300 MiB/second ...ββββββββ Volla Phone | 2250 MiB/second ...βββββββ Pinephone | 815 MiB/second ...β Xperia X | 795 MiB/second ...β Comparison Mutex Benchmark (less time is better): Librem 5 (PureOS) | 16.1842 seconds ...βββββββββββββββββββββββββ Meizu MX4 | 3.8107 seconds ...βββββ Nexus 5 | 2.7758 seconds ...βββ Nexus 4 | 2.4609 seconds ...βββ bq E5 | 2.4057 seconds ...βββ Volla Phone | 1.8590 seconds ...ββ M10 Tab + 2.gen | 1.8361 seconds ...ββ Xperia X | 1.6159 seconds ...ββ Cosmo Commun. | 1.2297 seconds ...β Xiaomi Mi A2 | 1.1919 seconds ...β Pinephone | 1.0368 seconds ...β Pixel 3a | 0.9193 seconds ...β The shown benchmarks only give a rough idea about a device's performance and do not fully represent the everyday performance of a device.
Hey, thanks for the summary, thats really interesting. I didn't test the app, I was rather thinking that this kind of diagram could be very helpful for someone who wants to pick a device to UT. It could maybe also be integrated into the devices list on the website?
Oh, and could anyone do a OnePlus 6T, as I was wondering if it would perform better than the VollaPhone?
-
OnePlus Nord 2:
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
2392 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
4593 events per secondsysbench --test=memory --num-threads=4 run
Operations performed: 104857600 (3975633.77 ops/sec)
102400.00 MB transferred (3882.45 MB/sec)sysbench --test=mutex --num-threads=64 run
total time: 0.7016ssysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
2379 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
4026 events per secondsysbench --test=memory --num-threads=4 run
Operations performed: 104857600 (3805878.96 ops/sec)
102400.00 MB transferred (3716.68 MB/sec)sysbench --test=mutex --num-threads=64 run
total time: 0.6906s -
@ikoz thank you really much. I was offline for some time and did not see your post, but I will add this data to the app with the next update.
-
Hello,
I moved this app from Ubuntu 16.04 to Ubuntu 20.04.
Some things changed with this and I am not sure, if the test is still consistent between versions (do to possible optimizations with 20.04 and a newer sysbench version).
I would be thankful, if some of you could install the app on a device with Ubuntu 20.04 and post the result after clicking on "Multiple Benchmarks".
Please do not switch to other apps or rotate the screen of your device while the test is running.
Should there be significant differences between OS versions, I will maybe need to consider this when working on the compare feature.
Thanks to everyone who helped me with this app and everyone who wants to help. -
@johndoe these are the results on my xiaomi mi a 2, devel, focal:
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run 1567 events per second sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run 2890 events per second sysbench --test=memory --num-threads=4 run Total operations: 50334961 (5028438.35 per second) 49155.24 MiB transferred (4910.58 MiB/sec) sysbench --test=mutex --num-threads=64 run total time: 8.6976s
hope that helps!
-
@messayisto Yes, thank you. This helps to confirm, that the test result of the app is not comparable between different OS versions.
Just to be sure: You also did not turn the screen of your device off when the test was running?
-
@johndoe No, I left the screen on, the test took only a few seconds.
-
-
@johndoe PinePhone UBports Edition on 20.04
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run 453 events per second sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run 901 events per second sysbench --test=memory --num-threads=4 run Total operations: 13723675 (1371392.07 per second) 13402.03 MiB transferred (1339.25 MiB/sec) sysbench --test=mutex --num-threads=64 run total time: 21.5289s
-
Samsung Galaxy s10e Exynos 9820 SM-G970F
Halium12ubuntu-sdk-20.04 sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run 1295 events per second sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run 4731 events per second sysbench --test=memory --num-threads=4 run Total operations: 55964278 (5595339.81 per second) 54652.62 MiB transferred (5464.20 MiB/sec) sysbench --test=mutex --num-threads=64 run total time: 3.4450s
-
Redmi Note 7
ubuntu-sdk-20.04
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1657 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
4755 events per secondsysbench --test=memory --num-threads=4 run
Total operations: 36500964 (3646830.87 per second)
35645.47 MiB transferred (3561.36 MiB/sec)sysbench --test=mutex --num-threads=64 run
total time: 4.8477ssysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1673 events per second -
Updated benchmarks for Nord 2 on 20.04
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
2492 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
4681 events per secondsysbench --test=memory --num-threads=4 run
Total operations: 104857600 (13066576.75 per second)
102400.00 MiB transferred (12760.33 MiB/sec)sysbench --test=mutex --num-threads=64 run
total time: 2.6850sThe noteworthy changes were that memory bandwidth has increased 4x, while mutex test decreased 2x, no significant change in cpu benchmarks.
However, because there is always room for improvement, I changed the governor, ajusted niceness and increased threads (although the phone has 8 cores sysbench didn't seem to use them all), and these were the results:
2643 for 2 threads,
4833 for 8 threads,
5634 for 12 threads,
and.... 6172 for 16 threadsMaybe the latter benchmarks are not considered valid. I also have to note that benchmarks varied a little (Β±100) with these changes.
-
Result for a
Sony Xperia X f5121
Ubuntu 16.04 (ota-25)
Use the buttons bellow to start a benchmark
(the results will be displayed after the benchmark
finished, this can take some time!).
Please do not turn off your device or switch to
other apps, when running the benchmark,
this will make the results of a benchmark useless.The results of a new benchmark will be displayed
under the results of performed benchmarks.Example results for the CPU Benchmark of a Nexus 4:
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
57 events per secondUse the buttons below to get results
that can be used to compare
your device with other devices.sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
1059 events per secondsysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
909 events per secondsysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
2684 events per secondsysbench --test=memory --num-threads=4 run
Operations performed: 104857600 (894135.77 ops/sec)
102400.00 MB transferred (873.18 MB/sec)sysbench --test=mutex --num-threads=64 run
total time: 1.5173s -
I used the test for 3 devices, here are the results:
- Device BQ Aquaris M10 FHD, Ubuntu 16.04
sysbench --test=cpu --num-threads=2 --Cpu-max-prime=20000 run 59 events per second
sysbench --test=cpu --num-threads=8 --Cpu-max-prime=20000 run 113 events per second
sysbench --test=memory --num-threads=4 run Operations performed: 0 ( 0.00 ops/sec) 0.00 MB transferred (0.00 MB/sec)
sysbench --test=mutex --num-threads=64 run total time: 0.9229s
- Device xperia X ubuntu-sdk-20.04
sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run 1385 events per second
sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run 2465 events per second
sysbench --test=memory --num-threads=4 run Total operations: 25487419 (2546616.80 per second) 24890.06 MiB transferred (2486.93 MiB/sec)
sysbench --test=mutex --num-threads=64 run total time: 9.2790s
- Device: pinetab2, ubuntu-sdk-20.04
sysbench -test=cpu -num-threads=2 -cpu-max-prime=20000 run 678 events per second
sysbench -test=cpu -num-threads=8 -cpu-max-prime=20000 run 1263 events per second
sysbench -testzmemory -num-threads=4 run Total operations: 50881276 (5086734.72 per second) 4968.75 MIB transferred (4967.51 MiB/sec)
sysbench -test=mutex -num-threads=64 run total time: 15.9498s
This result is quite in line with my observations when using these devices: Xperia X performance is quite good after the update to the new release.
Kind regards, Stefan