UBports Robot Logo UBports Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Search
    • Register
    • Login

    ut-sysbench-qt-gui: Compare CPU performance of different devices

    Scheduled Pinned Locked Moved App Development
    testingbenchmarkcompare
    46 Posts 18 Posters 9.7k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
      Reply
      • Reply as topic
      Log in to reply
      This topic has been deleted. Only users with topic management privileges can see it.
      • J Offline
        johndoe @sven
        last edited by

        This post is deleted!
        1 Reply Last reply Reply Quote 0
        • J Offline
          johndoe @sven
          last edited by

          @sven said in ut-sysbench-qt-gui: Compare CPU performance of different devices:

          @johndoe said in ut-sysbench-qt-gui: Compare CPU performance of different devices:

          if some of you could share your device's name together with a screenshot of the result you get

          A save (as plain text) button in the app would be great, so that people can post results for immediate processing via scripts or copy/paste.

          I will work on it.

          1 Reply Last reply Reply Quote 0
          • J Offline
            johndoe @cliffcoggin
            last edited by johndoe

            @cliffcoggin
            @kugiigi
            I will try to use QtQuick components instead of QtWidgets in a later version to prevent bugs, but I am no expert when it comes to Qt.
            Restarting the app or turning the screen will maybe fix graphical bugs.
            I don't know why the PinePhone crashes, maybe this will also be fixed with QtQuick components instead of QtWidgets:man_shrugging: .

            Thank you for testing the app.

            1 Reply Last reply Reply Quote 0
            • J Offline
              johndoe @sven
              last edited by johndoe

              @sven Restarting the app or rotating the screen will maybe fix graphical bugs. I will work on a solution.
              @MonCon 👍 👍

              1 Reply Last reply Reply Quote 0
              • ? Offline
                A Former User @sven
                last edited by A Former User

                @sven
                @johndoe
                The only graphical tweak I could think of that I've done to mine is to reduce the 'launcher width' in UT Tweak Tool from 8 to 6 to get a couple more pinned shortcuts on the left hand side of the screen. I reset the value to 8 and rebooted and the buttons disappeared, set the value back to 6 and the buttons reappeared, see attached screenshots.
                screenshot20210928_204104005x.png
                screenshot20210928_204152337x.png

                1 Reply Last reply Reply Quote 1
                • J Offline
                  johndoe @kugiigi
                  last edited by johndoe

                  @kugiigi I made some suggested changes to the app (including 'QtQuick components instead of QtWidgets'). It would be nice if you could try to run it on the Pinephone again and try to performe "Multiple Benchmarks", but be aware, that it will maybe crash again.

                  K S 2 Replies Last reply Reply Quote 0
                  • K Offline
                    kugiigi @johndoe
                    last edited by kugiigi

                    @johndoe Yup it's working now on the Pinephone. Thanks

                    Here's the results. I'm surprised it has a lot better results than phones like Nexus 5

                    sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                        617 events per second
                    
                    sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                        1190 events per second
                    
                    sysbench --test=memory --num-threads=4 run
                    Operations performed: 104857600 (875326.88 ops/sec)
                    102400.00 MB transferred (854.81 MB/sec)
                    
                    sysbench --test=mutex --num-threads=64 run
                        total time:                          1.0368s
                    
                    J 1 Reply Last reply Reply Quote 1
                    • S Offline
                      sven @johndoe
                      last edited by

                      The new version works perfectly on the Cosmo Communicator.

                      VollaPhone22 (dual-boot of VollaOS and UT 20.04 OTA-5), Pocophone F1 (pmOS, edge)

                      J 1 Reply Last reply Reply Quote 1
                      • J Offline
                        johndoe @kugiigi
                        last edited by johndoe

                        @kugiigi Thank you. Yes, this is really interesting. I think the difference between older phones and newer phones is so big, because the older phones have 32bit ARM CPUs and maybe ARM made changes for their 64bit architecture, that allows the CPU to perform way better in the specific workload in the sysbench CPU test.
                        What is even more interesting to me, is that that some phones with Mediatek CPUs perform better than the Pixel 3a and that the Librem 5 has similar results to the PinePhone (and not better results with a CPU that costs way more than an Allwinner A64).
                        I don't think that represents the everyday performance and responsiveness of the phones and I will maybe add a disclaimer to the app, that the results only give a rough idea about the performance, that the sysbench results are not 100% perfect and also other tests should be looked at when comparing devices.

                        Here are the results of the Librem5 with PureOS and results coming from a newer version of sysbench (maybe this could also explain why it did not perform better than the PinePhone, but I do not think so) :

                        sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                        events per second: 595.77

                        sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                        events per second: 1190.77

                        sysbench --test=memory --num-threads=4 run
                        5643286.07 ops per second
                        5511.02 MiB/sec

                        sysbench --test=mutex --num-threads=64 run
                        total time: 16.1842s

                        Source: https://forums.puri.sm/t/performance-compare-librem-5-to-ubuntu-touch-devices/15425

                        1 Reply Last reply Reply Quote 0
                        • J Offline
                          johndoe @sven
                          last edited by johndoe

                          @sven Nice. I would appreciate it, if you could also test the app on your OnePlus 3T and share the results of the benchmarks, if you have time for that.

                          S 1 Reply Last reply Reply Quote 0
                          • S Offline
                            sven @johndoe
                            last edited by

                            @johndoe Unfortunately, I borrowed the OnePlus 3T to a colleague; so I cannot run any tests ... at the moment.

                            VollaPhone22 (dual-boot of VollaOS and UT 20.04 OTA-5), Pocophone F1 (pmOS, edge)

                            J 1 Reply Last reply Reply Quote 0
                            • J Offline
                              johndoe @sven
                              last edited by

                              @sven Ok, no problem.

                              Y 1 Reply Last reply Reply Quote 0
                              • Y Offline
                                Yoni @johndoe
                                last edited by

                                @johndoe
                                Xiaomi mi A2 results:

                                sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                1717 events per second

                                sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                4915 events per second

                                sysbench --test=memory --num-threads=4 run
                                Operations performed: 104857600 (6280574.81 ops/sec)
                                102400.00 MB transferred (6133.37 MB/sec)

                                sysbench --test=mutex --num-threads=64 run
                                total time: 1.1919s

                                sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                1706 events per second

                                sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                5307 events per second

                                sysbench --test=memory --num-threads=4 run
                                Operations performed: 104857600 (6196075.77 ops/sec)
                                102400.00 MB transferred (6050.86 MB/sec)

                                sysbench --test=mutex --num-threads=64 run
                                total time: 1.1151s

                                sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                1705 events per second

                                sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                1706 events per second

                                1 Reply Last reply Reply Quote 1
                                • J Offline
                                  johndoe
                                  last edited by johndoe

                                  @yoni thank you 👍

                                  1 Reply Last reply Reply Quote 0
                                  • ? Offline
                                    A Former User
                                    last edited by A Former User

                                    @johndoe
                                    New version works perfectly on another Cosmo Communicator and another PinePhone.
                                    New export and compare function works flawlessly on both.
                                    Copy and paste results works on Cosmo, if only I could figure out how to Ctrl+V on the PinePhone touchscreen 🙄.
                                    Really nice looking app. From my very basic understanding of the numbers I would say the app accurately reflects my experience on the two devices I have in their current state of play.

                                    Cosmo Communicator
                                    sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                    1652 events per second

                                    sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                    5287 events per second

                                    sysbench --test=memory --num-threads=4 run
                                    Operations performed: 104857600 (2469862.22 ops/sec)
                                    102400.00 MB transferred (2411.97 MB/sec)

                                    sysbench --test=mutex --num-threads=64 run
                                    total time: 1.2297s

                                    PinePhone
                                    sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                    623 events per second

                                    sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                    1201 events per second

                                    sysbench --test=memory --num-threads=4 run
                                    Operations performed: 104857600 (932315.64 ops/sec)
                                    102400.00 MB transferred (910.46 MB/sec)

                                    sysbench --test=mutex --num-threads=64 run
                                    total time: 1.1598s

                                    J 1 Reply Last reply Reply Quote 1
                                    • J Offline
                                      johndoe @Guest
                                      last edited by johndoe

                                      @moncon Thanks, I think you can touch and hold a text field and then tap "Paste" to paste the text, that you have in the clipboard (but I see that you somehow managed to get the data of the Pinephone into your comment). It is good to see that the results are overall consistent with other phones from the same model.

                                      1 Reply Last reply Reply Quote 0
                                      • s710S Offline
                                        s710 @johndoe
                                        last edited by

                                        @johndoe said in ut-sysbench-qt-gui: Compare CPU performance of different devices:

                                        Hello,
                                        I wrote an app to compare the performance of different devices and released it on the OpenStore: https://open-store.io/app/ut-sysbench-qt-gui
                                        I hope the arm64 version works, because I can only test the armhf version.
                                        It would be nice, if some of you could share your device's name together with the results you get, after clicking on "Multiple Benchmarks".
                                        "Export and Compare" will copy the results to your clipboard and show you a bar chart with the performace of other devices.

                                        Multiple results from different persons for the same model are also useful.

                                        You are also free to share problems with my app. I know that the memory (RAM) test does not work on all devices.

                                        ----------------------------------------------------------------------------------------
                                        Results of my LG Nexus 4 with Ubuntu 16.04 OTA-19:

                                        sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                        57 events per second

                                        sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                        113 events per second

                                        sysbench --test=memory --num-threads=4 run
                                        Operations performed: 0 ( 0.00 ops/sec)
                                        0.00 MB transferred (0.00 MB/sec)

                                        sysbench --test=mutex --num-threads=64 run
                                        total time: 2.4057s

                                        Nice!

                                        Would it be possible to compile the user results into some kind of diagram/table which allows to easily compare device performance?

                                        J 1 Reply Last reply Reply Quote 0
                                        • J Offline
                                          johndoe @s710
                                          last edited by johndoe

                                          @s710 @s710 When you click on the button "Export and Compare", you should see a diagram that compares your device with other devices and the test results of your device will also be saved to your clipboard. If you want to export the shown diagram, you could take a screenshot (pressing power up and down at the same time or hold the power button and select "Screenshot" in the Lomiri power menu). You will also find what is shown in the app under:
                                          ~/.cache/ut-sysbench-qt-gui/messages/temp_message.txt

                                          The text file under "~/.cache/ut-sysbench-qt-gui/messages/temp_message.txt" should look something like this after you performed a CPU test and clicked on "Export and Compare":

                                          The results of the performed tests have been
                                          copied to your clipboard 📋
                                          (you can paste it into text fields
                                          of other apps or websites).
                                          
                                          Comparison CPU Benchmark (2 threads):
                                          
                                          Xiaomi Mi A2 | 1717 events/second
                                          ...█████████████████████████
                                          Cosmo Commun. | 1652 events/second
                                          ...████████████████████████
                                          M10 Tab + 2.gen | 1235 events/second
                                          ...██████████████████
                                          Volla Phone | 1091 events/second
                                          ...████████████████
                                          Xperia X | 1035 events/second
                                          ...███████████████
                                          Pixel 3a | 918 events/second
                                          ...█████████████
                                          Pinephone | 620 events/second
                                          ...█████████
                                          Librem 5 (PureOS) | 596 events/second
                                          ...████████
                                          Nexus 5 | 58 events/second
                                          ...█
                                          Nexus 4 | 57 events/second
                                          ...█
                                          This device | 57 events/second
                                          ...▒
                                          Meizu MX4 | 52 events/second
                                          ...█
                                          bq E5 | 46 events/second
                                          ...█
                                          
                                          
                                          Comparison CPU Benchmark (8 threads):
                                          
                                          Cosmo Commun. | 5287 events/second
                                          ...█████████████████████████
                                          Xiaomi Mi A2 | 4915 events/second
                                          ...███████████████████████
                                          M10 Tab + 2.gen | 4005 events/second
                                          ...███████████████████
                                          Pixel 3a | 3973 events/second
                                          ...██████████████████
                                          Volla Phone | 3788 events/second
                                          ...██████████████████
                                          Xperia X | 2467 events/second
                                          ...███████████
                                          Librem 5 (PureOS) | 1191 events/second
                                          ...██████
                                          Pinephone | 1190 events/second
                                          ...██████
                                          Meizu MX4 | 146 events/second
                                          ...█
                                          Nexus 4 | 113 events/second
                                          ...█
                                          Nexus 5 | 96 events/second
                                          ...█
                                          bq E5 | 91 events/second
                                          ...█
                                          
                                          
                                          Comparison Memory Benchmark (no armhf devices):
                                          
                                          Xiaomi Mi A2 | 5849 MiB/second
                                          ...█████████████████████████
                                          Librem 5 (PureOS) | 5511 MiB/second
                                          ...███████████████████████
                                          Pixel 3a | 2560 MiB/second
                                          ...███████████████████████
                                          M10 Tab + 2.gen | 2443 MiB/second
                                          ...████████
                                          Cosmo Commun. | 2300 MiB/second
                                          ...████████
                                          Volla Phone | 2250 MiB/second
                                          ...███████
                                          Pinephone | 815 MiB/second
                                          ...█
                                          Xperia X | 795 MiB/second
                                          ...█
                                          
                                          
                                          Comparison Mutex Benchmark (less time is better):
                                          
                                          Librem 5 (PureOS) | 16.1842 seconds
                                          ...█████████████████████████
                                          Meizu MX4 | 3.8107 seconds
                                          ...█████
                                          Nexus 5 | 2.7758 seconds
                                          ...███
                                          Nexus 4 | 2.4609 seconds
                                          ...███
                                          bq E5 | 2.4057 seconds
                                          ...███
                                          Volla Phone | 1.8590 seconds
                                          ...██
                                          M10 Tab + 2.gen | 1.8361 seconds
                                          ...██
                                          Xperia X | 1.6159 seconds
                                          ...██
                                          Cosmo Commun. | 1.2297 seconds
                                          ...█
                                          Xiaomi Mi A2 | 1.1919 seconds
                                          ...█
                                          Pinephone | 1.0368 seconds
                                          ...█
                                          Pixel 3a | 0.9193 seconds
                                          ...█
                                          
                                          
                                          The shown benchmarks only give a rough idea
                                          about a device's performance and do not
                                          fully represent the everyday performance of
                                          a device.
                                          
                                          s710S 1 Reply Last reply Reply Quote 0
                                          • s710S Offline
                                            s710 @johndoe
                                            last edited by

                                            @johndoe said in ut-sysbench-qt-gui: Compare CPU performance of different devices:

                                            @s710 @s710 When you click on the button "Export and Compare", you should see a diagram that compares your device with other devices and the test results of your device will also be saved to your clipboard. If you want to export the shown diagram, you could take a screenshot (pressing power up and down at the same time or hold the power button and select "Screenshot" in the Lomiri power menu). You will also find what is shown in the app under:
                                            ~/.cache/ut-sysbench-qt-gui/messages/temp_message.txt

                                            The text file under "~/.cache/ut-sysbench-qt-gui/messages/temp_message.txt" should look something like this after you performed a CPU test and clicked on "Export and Compare":

                                            The results of the performed tests have been
                                            copied to your clipboard 📋
                                            (you can paste it into text fields
                                            of other apps or websites).
                                            
                                            Comparison CPU Benchmark (2 threads):
                                            
                                            Xiaomi Mi A2 | 1717 events/second
                                            ...█████████████████████████
                                            Cosmo Commun. | 1652 events/second
                                            ...████████████████████████
                                            M10 Tab + 2.gen | 1235 events/second
                                            ...██████████████████
                                            Volla Phone | 1091 events/second
                                            ...████████████████
                                            Xperia X | 1035 events/second
                                            ...███████████████
                                            Pixel 3a | 918 events/second
                                            ...█████████████
                                            Pinephone | 620 events/second
                                            ...█████████
                                            Librem 5 (PureOS) | 596 events/second
                                            ...████████
                                            Nexus 5 | 58 events/second
                                            ...█
                                            Nexus 4 | 57 events/second
                                            ...█
                                            This device | 57 events/second
                                            ...▒
                                            Meizu MX4 | 52 events/second
                                            ...█
                                            bq E5 | 46 events/second
                                            ...█
                                            
                                            
                                            Comparison CPU Benchmark (8 threads):
                                            
                                            Cosmo Commun. | 5287 events/second
                                            ...█████████████████████████
                                            Xiaomi Mi A2 | 4915 events/second
                                            ...███████████████████████
                                            M10 Tab + 2.gen | 4005 events/second
                                            ...███████████████████
                                            Pixel 3a | 3973 events/second
                                            ...██████████████████
                                            Volla Phone | 3788 events/second
                                            ...██████████████████
                                            Xperia X | 2467 events/second
                                            ...███████████
                                            Librem 5 (PureOS) | 1191 events/second
                                            ...██████
                                            Pinephone | 1190 events/second
                                            ...██████
                                            Meizu MX4 | 146 events/second
                                            ...█
                                            Nexus 4 | 113 events/second
                                            ...█
                                            Nexus 5 | 96 events/second
                                            ...█
                                            bq E5 | 91 events/second
                                            ...█
                                            
                                            
                                            Comparison Memory Benchmark (no armhf devices):
                                            
                                            Xiaomi Mi A2 | 5849 MiB/second
                                            ...█████████████████████████
                                            Librem 5 (PureOS) | 5511 MiB/second
                                            ...███████████████████████
                                            Pixel 3a | 2560 MiB/second
                                            ...███████████████████████
                                            M10 Tab + 2.gen | 2443 MiB/second
                                            ...████████
                                            Cosmo Commun. | 2300 MiB/second
                                            ...████████
                                            Volla Phone | 2250 MiB/second
                                            ...███████
                                            Pinephone | 815 MiB/second
                                            ...█
                                            Xperia X | 795 MiB/second
                                            ...█
                                            
                                            
                                            Comparison Mutex Benchmark (less time is better):
                                            
                                            Librem 5 (PureOS) | 16.1842 seconds
                                            ...█████████████████████████
                                            Meizu MX4 | 3.8107 seconds
                                            ...█████
                                            Nexus 5 | 2.7758 seconds
                                            ...███
                                            Nexus 4 | 2.4609 seconds
                                            ...███
                                            bq E5 | 2.4057 seconds
                                            ...███
                                            Volla Phone | 1.8590 seconds
                                            ...██
                                            M10 Tab + 2.gen | 1.8361 seconds
                                            ...██
                                            Xperia X | 1.6159 seconds
                                            ...██
                                            Cosmo Commun. | 1.2297 seconds
                                            ...█
                                            Xiaomi Mi A2 | 1.1919 seconds
                                            ...█
                                            Pinephone | 1.0368 seconds
                                            ...█
                                            Pixel 3a | 0.9193 seconds
                                            ...█
                                            
                                            
                                            The shown benchmarks only give a rough idea
                                            about a device's performance and do not
                                            fully represent the everyday performance of
                                            a device.
                                            

                                            Hey, thanks for the summary, thats really interesting. I didn't test the app, I was rather thinking that this kind of diagram could be very helpful for someone who wants to pick a device to UT. It could maybe also be integrated into the devices list on the website?

                                            Oh, and could anyone do a OnePlus 6T, as I was wondering if it would perform better than the VollaPhone?

                                            1 Reply Last reply Reply Quote 0
                                            • ikozI Offline
                                              ikoz
                                              last edited by

                                              OnePlus Nord 2:

                                              sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                              2392 events per second

                                              sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                              4593 events per second

                                              sysbench --test=memory --num-threads=4 run
                                              Operations performed: 104857600 (3975633.77 ops/sec)
                                              102400.00 MB transferred (3882.45 MB/sec)

                                              sysbench --test=mutex --num-threads=64 run
                                              total time: 0.7016s

                                              sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                              2379 events per second

                                              sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                              4026 events per second

                                              sysbench --test=memory --num-threads=4 run
                                              Operations performed: 104857600 (3805878.96 ops/sec)
                                              102400.00 MB transferred (3716.68 MB/sec)

                                              sysbench --test=mutex --num-threads=64 run
                                              total time: 0.6906s

                                              May the source be with you

                                              J 1 Reply Last reply Reply Quote 1
                                              • First post
                                                Last post