@hoogs I had the same issue. I did not find a fix. The only thing I found out is, that it did not happen if I play the music via bluetooth. I bought a cheap bluetooth receiver for my headphones and used it like this for a few weeks.
Because I had other issues with anbox (regarding camera freezes, nexus 5), I removed anbox again.