Interesting. I run Ubuntu Mate on my Raspberry Pi instead of the default OS, which runs much more similarly to a regular Ubuntu distribution. Maybe trying on that platform would merit another try.
I was using ubuntu mate as well. It is still an arm chip though so you have compile the toolchain from source for that platform.