UBports Robot Logo UBports Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Search
    • Register
    • Login

    ut-sysbench-qt-gui: Compare CPU performance of different devices

    Scheduled Pinned Locked Moved App Development
    testingbenchmarkcompare
    46 Posts 18 Posters 9.8k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
      Reply
      • Reply as topic
      Log in to reply
      This topic has been deleted. Only users with topic management privileges can see it.
      • s710S Offline
        s710 @johndoe
        last edited by

        @johndoe said in ut-sysbench-qt-gui: Compare CPU performance of different devices:

        @s710 @s710 When you click on the button "Export and Compare", you should see a diagram that compares your device with other devices and the test results of your device will also be saved to your clipboard. If you want to export the shown diagram, you could take a screenshot (pressing power up and down at the same time or hold the power button and select "Screenshot" in the Lomiri power menu). You will also find what is shown in the app under:
        ~/.cache/ut-sysbench-qt-gui/messages/temp_message.txt

        The text file under "~/.cache/ut-sysbench-qt-gui/messages/temp_message.txt" should look something like this after you performed a CPU test and clicked on "Export and Compare":

        The results of the performed tests have been
        copied to your clipboard πŸ“‹
        (you can paste it into text fields
        of other apps or websites).
        
        Comparison CPU Benchmark (2 threads):
        
        Xiaomi Mi A2 | 1717 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Cosmo Commun. | 1652 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        M10 Tab + 2.gen | 1235 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Volla Phone | 1091 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Xperia X | 1035 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Pixel 3a | 918 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Pinephone | 620 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Librem 5 (PureOS) | 596 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Nexus 5 | 58 events/second
        ...β–ˆ
        Nexus 4 | 57 events/second
        ...β–ˆ
        This device | 57 events/second
        ...β–’
        Meizu MX4 | 52 events/second
        ...β–ˆ
        bq E5 | 46 events/second
        ...β–ˆ
        
        
        Comparison CPU Benchmark (8 threads):
        
        Cosmo Commun. | 5287 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Xiaomi Mi A2 | 4915 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        M10 Tab + 2.gen | 4005 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Pixel 3a | 3973 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Volla Phone | 3788 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Xperia X | 2467 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Librem 5 (PureOS) | 1191 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Pinephone | 1190 events/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Meizu MX4 | 146 events/second
        ...β–ˆ
        Nexus 4 | 113 events/second
        ...β–ˆ
        Nexus 5 | 96 events/second
        ...β–ˆ
        bq E5 | 91 events/second
        ...β–ˆ
        
        
        Comparison Memory Benchmark (no armhf devices):
        
        Xiaomi Mi A2 | 5849 MiB/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Librem 5 (PureOS) | 5511 MiB/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Pixel 3a | 2560 MiB/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        M10 Tab + 2.gen | 2443 MiB/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Cosmo Commun. | 2300 MiB/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Volla Phone | 2250 MiB/second
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Pinephone | 815 MiB/second
        ...β–ˆ
        Xperia X | 795 MiB/second
        ...β–ˆ
        
        
        Comparison Mutex Benchmark (less time is better):
        
        Librem 5 (PureOS) | 16.1842 seconds
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Meizu MX4 | 3.8107 seconds
        ...β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
        Nexus 5 | 2.7758 seconds
        ...β–ˆβ–ˆβ–ˆ
        Nexus 4 | 2.4609 seconds
        ...β–ˆβ–ˆβ–ˆ
        bq E5 | 2.4057 seconds
        ...β–ˆβ–ˆβ–ˆ
        Volla Phone | 1.8590 seconds
        ...β–ˆβ–ˆ
        M10 Tab + 2.gen | 1.8361 seconds
        ...β–ˆβ–ˆ
        Xperia X | 1.6159 seconds
        ...β–ˆβ–ˆ
        Cosmo Commun. | 1.2297 seconds
        ...β–ˆ
        Xiaomi Mi A2 | 1.1919 seconds
        ...β–ˆ
        Pinephone | 1.0368 seconds
        ...β–ˆ
        Pixel 3a | 0.9193 seconds
        ...β–ˆ
        
        
        The shown benchmarks only give a rough idea
        about a device's performance and do not
        fully represent the everyday performance of
        a device.
        

        Hey, thanks for the summary, thats really interesting. I didn't test the app, I was rather thinking that this kind of diagram could be very helpful for someone who wants to pick a device to UT. It could maybe also be integrated into the devices list on the website?

        Oh, and could anyone do a OnePlus 6T, as I was wondering if it would perform better than the VollaPhone?

        1 Reply Last reply Reply Quote 0
        • ikozI Offline
          ikoz
          last edited by

          OnePlus Nord 2:

          sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
          2392 events per second

          sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
          4593 events per second

          sysbench --test=memory --num-threads=4 run
          Operations performed: 104857600 (3975633.77 ops/sec)
          102400.00 MB transferred (3882.45 MB/sec)

          sysbench --test=mutex --num-threads=64 run
          total time: 0.7016s

          sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
          2379 events per second

          sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
          4026 events per second

          sysbench --test=memory --num-threads=4 run
          Operations performed: 104857600 (3805878.96 ops/sec)
          102400.00 MB transferred (3716.68 MB/sec)

          sysbench --test=mutex --num-threads=64 run
          total time: 0.6906s

          May the source be with you

          J 1 Reply Last reply Reply Quote 1
          • J Offline
            johndoe @ikoz
            last edited by

            @ikoz thank you really much. I was offline for some time and did not see your post, but I will add this data to the app with the next update.

            1 Reply Last reply Reply Quote 0
            • J Offline
              johndoe
              last edited by

              Hello,
              I moved this app from Ubuntu 16.04 to Ubuntu 20.04.
              Some things changed with this and I am not sure, if the test is still consistent between versions (do to possible optimizations with 20.04 and a newer sysbench version).
              I would be thankful, if some of you could install the app on a device with Ubuntu 20.04 and post the result after clicking on "Multiple Benchmarks".
              Please do not switch to other apps or rotate the screen of your device while the test is running.
              Should there be significant differences between OS versions, I will maybe need to consider this when working on the compare feature.
              Thanks to everyone who helped me with this app and everyone who wants to help.

              messayistoM ikozI 2 Replies Last reply Reply Quote 0
              • messayistoM Offline
                messayisto @johndoe
                last edited by

                @johndoe these are the results on my xiaomi mi a 2, devel, focal:

                sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                     1567 events per second
                
                sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                     2890 events per second
                
                sysbench --test=memory --num-threads=4 run
                Total operations: 50334961 (5028438.35 per second)
                49155.24 MiB transferred (4910.58 MiB/sec)
                
                sysbench --test=mutex --num-threads=64 run
                     total time:                          8.6976s
                

                hope that helps!

                J 1 Reply Last reply Reply Quote 1
                • J Offline
                  johndoe @messayisto
                  last edited by

                  @messayisto Yes, thank you. This helps to confirm, that the test result of the app is not comparable between different OS versions.

                  Just to be sure: You also did not turn the screen of your device off when the test was running?

                  messayistoM 1 Reply Last reply Reply Quote 1
                  • messayistoM Offline
                    messayisto @johndoe
                    last edited by

                    @johndoe No, I left the screen on, the test took only a few seconds.

                    J 1 Reply Last reply Reply Quote 1
                    • J Offline
                      johndoe @messayisto
                      last edited by

                      @messayisto πŸ‘

                      arubislanderA 1 Reply Last reply Reply Quote 0
                      • arubislanderA Offline
                        arubislander @johndoe
                        last edited by arubislander

                        @johndoe PinePhone UBports Edition on 20.04

                        sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                              453 events per second
                        
                        sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                              901 events per second
                        
                        sysbench --test=memory --num-threads=4 run
                        Total operations: 13723675 (1371392.07 per second)
                        13402.03 MiB transferred (1339.25 MiB/sec)
                        
                        sysbench --test=mutex --num-threads=64 run
                             total time:                          21.5289s
                        

                        πŸ‡¦πŸ‡Ό πŸ‡³πŸ‡± πŸ‡ΊπŸ‡Έ πŸ‡ͺπŸ‡Έ
                        Happily running Ubuntu Touch
                        Google Pixel 3a (20.04 DEV)
                        JingPad (24.04 preview)
                        Meizu Pro 5 (16.04 DEV)

                        1 Reply Last reply Reply Quote 1
                        • L Offline
                          laschrocket
                          last edited by laschrocket

                          Samsung Galaxy s10e Exynos 9820 SM-G970F
                          Halium12

                          ubuntu-sdk-20.04
                          
                          sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                               1295 events per second
                          
                          sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                               4731 events per second
                          
                          sysbench --test=memory --num-threads=4 run
                          Total operations: 55964278 (5595339.81 per second)
                          54652.62 MiB transferred (5464.20 MiB/sec)
                          
                          sysbench --test=mutex --num-threads=64 run
                               total time:                          3.4450s
                          
                          1 Reply Last reply Reply Quote 1
                          • D Offline
                            dioginfo
                            last edited by

                            Redmi Note 7

                            ubuntu-sdk-20.04

                            sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                            1657 events per second

                            sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                            4755 events per second

                            sysbench --test=memory --num-threads=4 run
                            Total operations: 36500964 (3646830.87 per second)
                            35645.47 MiB transferred (3561.36 MiB/sec)

                            sysbench --test=mutex --num-threads=64 run
                            total time: 4.8477s

                            sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                            1673 events per second

                            J 1 Reply Last reply Reply Quote 1
                            • ikozI Offline
                              ikoz @johndoe
                              last edited by

                              Updated benchmarks for Nord 2 on 20.04
                              sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                              2492 events per second

                              sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                              4681 events per second

                              sysbench --test=memory --num-threads=4 run
                              Total operations: 104857600 (13066576.75 per second)
                              102400.00 MiB transferred (12760.33 MiB/sec)

                              sysbench --test=mutex --num-threads=64 run
                              total time: 2.6850s

                              The noteworthy changes were that memory bandwidth has increased 4x, while mutex test decreased 2x, no significant change in cpu benchmarks.

                              However, because there is always room for improvement, I changed the governor, ajusted niceness and increased threads (although the phone has 8 cores sysbench didn't seem to use them all), and these were the results:
                              2643 for 2 threads,
                              4833 for 8 threads,
                              5634 for 12 threads,
                              and.... 6172 for 16 threads

                              Maybe the latter benchmarks are not considered valid. I also have to note that benchmarks varied a little (Β±100) with these changes.

                              May the source be with you

                              1 Reply Last reply Reply Quote 1
                              • DJacD Offline
                                DJac
                                last edited by

                                Result for a
                                Sony Xperia X f5121
                                Ubuntu 16.04 (ota-25)
                                Use the buttons bellow to start a benchmark
                                (the results will be displayed after the benchmark
                                finished, this can take some time!).
                                Please do not turn off your device or switch to
                                other apps, when running the benchmark,
                                this will make the results of a benchmark useless.

                                The results of a new benchmark will be displayed
                                under the results of performed benchmarks.

                                Example results for the CPU Benchmark of a Nexus 4:
                                sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                57 events per second

                                Use the buttons below to get results
                                that can be used to compare
                                your device with other devices.

                                sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                1059 events per second

                                sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                909 events per second

                                sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                2684 events per second

                                sysbench --test=memory --num-threads=4 run
                                Operations performed: 104857600 (894135.77 ops/sec)
                                102400.00 MB transferred (873.18 MB/sec)

                                sysbench --test=mutex --num-threads=64 run
                                total time: 1.5173s

                                S 1 Reply Last reply Reply Quote 1
                                • S Offline
                                  stefan_hdb @DJac
                                  last edited by

                                  I used the test for 3 devices, here are the results:

                                  1. Device BQ Aquaris M10 FHD, Ubuntu 16.04

                                  sysbench --test=cpu --num-threads=2 --Cpu-max-prime=20000 run 59 events per second

                                  sysbench --test=cpu --num-threads=8 --Cpu-max-prime=20000 run 113 events per second

                                  sysbench --test=memory --num-threads=4 run Operations performed: 0 ( 0.00 ops/sec) 0.00 MB transferred (0.00 MB/sec)

                                  sysbench --test=mutex --num-threads=64 run total time: 0.9229s

                                  1. Device xperia X ubuntu-sdk-20.04

                                  sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run 1385 events per second

                                  sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run 2465 events per second

                                  sysbench --test=memory --num-threads=4 run Total operations: 25487419 (2546616.80 per second) 24890.06 MiB transferred (2486.93 MiB/sec)

                                  sysbench --test=mutex --num-threads=64 run total time: 9.2790s

                                  1. Device: pinetab2, ubuntu-sdk-20.04

                                  sysbench -test=cpu -num-threads=2 -cpu-max-prime=20000 run 678 events per second

                                  sysbench -test=cpu -num-threads=8 -cpu-max-prime=20000 run 1263 events per second

                                  sysbench -testzmemory -num-threads=4 run Total operations: 50881276 (5086734.72 per second) 4968.75 MIB transferred (4967.51 MiB/sec)

                                  sysbench -test=mutex -num-threads=64 run total time: 15.9498s

                                  This result is quite in line with my observations when using these devices: Xperia X performance is quite good after the update to the new release.

                                  Kind regards, Stefan

                                  Stefan
                                  happy to run Ubuntu Touch on Sony Xperia X, Lenovo TBX306-FA

                                  1 Reply Last reply Reply Quote 1
                                  • J Offline
                                    johndoe @dioginfo
                                    last edited by

                                    @dioginfo @ikoz @DJac @stefan_hdb
                                    Thank you for the data. I will use it for the next update. πŸ‘ But it could maybe take until next month for me to have time for it. ⏳

                                    1 Reply Last reply Reply Quote 0
                                    • S Offline
                                      sven
                                      last edited by

                                      I ran the benchmarks on a Gigaset GS5 Pro with Ubuntu 20.04 OTA-4:

                                      sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run 1650 events per second

                                      sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run 3735 events per second

                                      sysbench --test=memory --num-threads=4 run Total Operations: 60181714 ( 6017004 per second) 58771.21 MiB transferred

                                      sysbench --test=mutex --num-threads=64 run total time: 5.0982s

                                      VollaPhone22 (dual-boot of VollaOS and UT 20.04 OTA-5), Pocophone F1 (pmOS, edge)

                                      1 Reply Last reply Reply Quote 2
                                      • S Offline
                                        StephPTi
                                        last edited by

                                        Here is my Poco X3 NFC on 20.04 dev

                                        screenshot20240204_001406079.png

                                        Languages: πŸ‡΅πŸ‡ΉπŸ‡ΊπŸ‡ΈπŸ‡«πŸ‡·
                                        Phones: POCO X3 NFC (Focal 20.04 dev)

                                        1 Reply Last reply Reply Quote 1
                                        • A Offline
                                          ancientsounds
                                          last edited by

                                          OnePlus 6T:

                                          ubuntu-sdk-20.04

                                          sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                          1095 events per second

                                          sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                          1089 events per second

                                          sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                          3063 events per second

                                          sysbench --test=memory --num-threads=4 run
                                          Total operations: 25124442 (2511263.68 per second)
                                          24535.59 MiB transferred (2452.41 MiB/sec)

                                          sysbench --test=mutex --num-threads=64 run
                                          total time: 6.2309s

                                          C 1 Reply Last reply Reply Quote 2
                                          • C Offline
                                            Charly @ancientsounds
                                            last edited by

                                            Volla X23:

                                            ubuntu-sdk-20.04

                                            sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                            1924 events per second

                                            sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                            1927 events per second

                                            sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                            4222 events per second

                                            sysbench --test=memory --num-threads=4 run
                                            Total operations: 69640008 (696072.68 per second)
                                            68007.82 MiB transferred (6799.51 MiB/sec)

                                            sysbench --test=mutex --num-threads=64 run
                                            total time: 4.2907s

                                            Greetings
                                            Charly

                                            UT 20.04 on Volla X23

                                            1 Reply Last reply Reply Quote 2
                                            • First post
                                              Last post