UBports Robot Logo UBports Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Search
    • Register
    • Login

    ut-sysbench-qt-gui: Compare CPU performance of different devices

    Scheduled Pinned Locked Moved App Development
    testingbenchmarkcompare
    46 Posts 18 Posters 9.7k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
      Reply
      • Reply as topic
      Log in to reply
      This topic has been deleted. Only users with topic management privileges can see it.
      • D Offline
        domubpkm
        last edited by

        Volla Phone (arm64). Tested RC 33

        CPU Benchmark (5 times same test)
        screenshot20210926_211511664.png

        Multiple Benchmarks
        screenshot20210926_211757232.png

        What does mean this ???
        screenshot20210926_211757232.png

        J 1 Reply Last reply Reply Quote 1
        • ? Offline
          A Former User
          last edited by

          Works on Cosmo Communicator, copes with landscape view as well. 🙂
          Result of 'multiple benchmarks' below:
          screenshot20210927_085955025.png

          S 1 Reply Last reply Reply Quote 1
          • S Offline
            sven
            last edited by

            @johndoe said in ut-sysbench-qt-gui: Compare CPU performance of different devices:

            if some of you could share your device's name together with a screenshot of the result you get

            A save (as plain text) button in the app would be great, so that people can post results for immediate processing via scripts or copy/paste.

            VollaPhone22 (dual-boot of VollaOS and UT 20.04 OTA-5), Pocophone F1 (pmOS, edge)

            J 2 Replies Last reply Reply Quote 1
            • K Offline
              kugiigi
              last edited by kugiigi

              Copy results to clipboard would definitely be great 🙂
              Also, maybe use QtQuick components instead of QtWidgets so that the UI would be more touch-friendly
              Lastly, this crashes on the Pinephone, actually it crashes Lomiri LOL

              Here's the results:
              **Lenovo M10 Tab Plus (2nd gen)
              screenshot20210928_020419169.png

              Pixel 3a
              Pixel3a.png

              Nexus5
              Nexus5.png

              bq E5
              bqE5.png

              Xperia X
              Xperia X.png

              Meizu MX4
              Mx4.png

              1 Reply Last reply Reply Quote 1
              • S Offline
                sven @Guest
                last edited by

                @moncon said in ut-sysbench-qt-gui: Compare CPU performance of different devices:

                Works on Cosmo Communicator, copes with landscape view as well.

                Same device, OTA-19: the two lower buttons are not visible for me. How did you manage to see them?

                VollaPhone22 (dual-boot of VollaOS and UT 20.04 OTA-5), Pocophone F1 (pmOS, edge)

                K J ? 3 Replies Last reply Reply Quote 1
                • K Offline
                  kugiigi @sven
                  last edited by

                  @sven That seems to be a bug, probably because the app uses Widgets that aren't really suitable for touch and not responsive enough. You can rotate the screen and it'll be fixed after that.

                  J 1 Reply Last reply Reply Quote 1
                  • J Offline
                    johndoe @domubpkm
                    last edited by

                    @domubpkm
                    Thank you really much.

                    The memory test shows the RAM speed and it is good to see that it works on some devices. So it is maybe not a problem with Ubuntu Touch and I maybe need to change the parameters, so that we get results on all devices.

                    The mutex test shows the speed of mutual exclusions (less time is better). Sometimes multiple processes want access to the same files at the same time and this access permissions need to be managed. This management is done by mutexes.

                    1 Reply Last reply Reply Quote 1
                    • J Offline
                      johndoe @sven
                      last edited by

                      This post is deleted!
                      1 Reply Last reply Reply Quote 0
                      • J Offline
                        johndoe @sven
                        last edited by

                        @sven said in ut-sysbench-qt-gui: Compare CPU performance of different devices:

                        @johndoe said in ut-sysbench-qt-gui: Compare CPU performance of different devices:

                        if some of you could share your device's name together with a screenshot of the result you get

                        A save (as plain text) button in the app would be great, so that people can post results for immediate processing via scripts or copy/paste.

                        I will work on it.

                        1 Reply Last reply Reply Quote 0
                        • J Offline
                          johndoe @cliffcoggin
                          last edited by johndoe

                          @cliffcoggin
                          @kugiigi
                          I will try to use QtQuick components instead of QtWidgets in a later version to prevent bugs, but I am no expert when it comes to Qt.
                          Restarting the app or turning the screen will maybe fix graphical bugs.
                          I don't know why the PinePhone crashes, maybe this will also be fixed with QtQuick components instead of QtWidgets:man_shrugging: .

                          Thank you for testing the app.

                          1 Reply Last reply Reply Quote 0
                          • J Offline
                            johndoe @sven
                            last edited by johndoe

                            @sven Restarting the app or rotating the screen will maybe fix graphical bugs. I will work on a solution.
                            @MonCon 👍 👍

                            1 Reply Last reply Reply Quote 0
                            • ? Offline
                              A Former User @sven
                              last edited by A Former User

                              @sven
                              @johndoe
                              The only graphical tweak I could think of that I've done to mine is to reduce the 'launcher width' in UT Tweak Tool from 8 to 6 to get a couple more pinned shortcuts on the left hand side of the screen. I reset the value to 8 and rebooted and the buttons disappeared, set the value back to 6 and the buttons reappeared, see attached screenshots.
                              screenshot20210928_204104005x.png
                              screenshot20210928_204152337x.png

                              1 Reply Last reply Reply Quote 1
                              • J Offline
                                johndoe @kugiigi
                                last edited by johndoe

                                @kugiigi I made some suggested changes to the app (including 'QtQuick components instead of QtWidgets'). It would be nice if you could try to run it on the Pinephone again and try to performe "Multiple Benchmarks", but be aware, that it will maybe crash again.

                                K S 2 Replies Last reply Reply Quote 0
                                • K Offline
                                  kugiigi @johndoe
                                  last edited by kugiigi

                                  @johndoe Yup it's working now on the Pinephone. Thanks

                                  Here's the results. I'm surprised it has a lot better results than phones like Nexus 5

                                  sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                      617 events per second
                                  
                                  sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                      1190 events per second
                                  
                                  sysbench --test=memory --num-threads=4 run
                                  Operations performed: 104857600 (875326.88 ops/sec)
                                  102400.00 MB transferred (854.81 MB/sec)
                                  
                                  sysbench --test=mutex --num-threads=64 run
                                      total time:                          1.0368s
                                  
                                  J 1 Reply Last reply Reply Quote 1
                                  • S Offline
                                    sven @johndoe
                                    last edited by

                                    The new version works perfectly on the Cosmo Communicator.

                                    VollaPhone22 (dual-boot of VollaOS and UT 20.04 OTA-5), Pocophone F1 (pmOS, edge)

                                    J 1 Reply Last reply Reply Quote 1
                                    • J Offline
                                      johndoe @kugiigi
                                      last edited by johndoe

                                      @kugiigi Thank you. Yes, this is really interesting. I think the difference between older phones and newer phones is so big, because the older phones have 32bit ARM CPUs and maybe ARM made changes for their 64bit architecture, that allows the CPU to perform way better in the specific workload in the sysbench CPU test.
                                      What is even more interesting to me, is that that some phones with Mediatek CPUs perform better than the Pixel 3a and that the Librem 5 has similar results to the PinePhone (and not better results with a CPU that costs way more than an Allwinner A64).
                                      I don't think that represents the everyday performance and responsiveness of the phones and I will maybe add a disclaimer to the app, that the results only give a rough idea about the performance, that the sysbench results are not 100% perfect and also other tests should be looked at when comparing devices.

                                      Here are the results of the Librem5 with PureOS and results coming from a newer version of sysbench (maybe this could also explain why it did not perform better than the PinePhone, but I do not think so) :

                                      sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                      events per second: 595.77

                                      sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                      events per second: 1190.77

                                      sysbench --test=memory --num-threads=4 run
                                      5643286.07 ops per second
                                      5511.02 MiB/sec

                                      sysbench --test=mutex --num-threads=64 run
                                      total time: 16.1842s

                                      Source: https://forums.puri.sm/t/performance-compare-librem-5-to-ubuntu-touch-devices/15425

                                      1 Reply Last reply Reply Quote 0
                                      • J Offline
                                        johndoe @sven
                                        last edited by johndoe

                                        @sven Nice. I would appreciate it, if you could also test the app on your OnePlus 3T and share the results of the benchmarks, if you have time for that.

                                        S 1 Reply Last reply Reply Quote 0
                                        • S Offline
                                          sven @johndoe
                                          last edited by

                                          @johndoe Unfortunately, I borrowed the OnePlus 3T to a colleague; so I cannot run any tests ... at the moment.

                                          VollaPhone22 (dual-boot of VollaOS and UT 20.04 OTA-5), Pocophone F1 (pmOS, edge)

                                          J 1 Reply Last reply Reply Quote 0
                                          • J Offline
                                            johndoe @sven
                                            last edited by

                                            @sven Ok, no problem.

                                            Y 1 Reply Last reply Reply Quote 0
                                            • Y Offline
                                              Yoni @johndoe
                                              last edited by

                                              @johndoe
                                              Xiaomi mi A2 results:

                                              sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                              1717 events per second

                                              sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                              4915 events per second

                                              sysbench --test=memory --num-threads=4 run
                                              Operations performed: 104857600 (6280574.81 ops/sec)
                                              102400.00 MB transferred (6133.37 MB/sec)

                                              sysbench --test=mutex --num-threads=64 run
                                              total time: 1.1919s

                                              sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                              1706 events per second

                                              sysbench --test=cpu --num-threads=8 --cpu-max-prime=20000 run
                                              5307 events per second

                                              sysbench --test=memory --num-threads=4 run
                                              Operations performed: 104857600 (6196075.77 ops/sec)
                                              102400.00 MB transferred (6050.86 MB/sec)

                                              sysbench --test=mutex --num-threads=64 run
                                              total time: 1.1151s

                                              sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                              1705 events per second

                                              sysbench --test=cpu --num-threads=2 --cpu-max-prime=20000 run
                                              1706 events per second

                                              1 Reply Last reply Reply Quote 1
                                              • First post
                                                Last post