Just a little update:
dmesg -w output is:
MTP works fine. I can transfer files no problem.
On my old homeserver running debian buster, adb works (somewhat). I need to try plugging it in a couple of times sometimes. Similar to the installation trouble on the M10.
Thought I'd leave this here for future reference. There is definetly something wrong with the M10 that causes these weird problems though. Thanksfully it has OTG, so I can hook my keyboard up to it.
If a developer wants to maybe try finding out more about the issue, I am up for helping with testing/troubleshooting.