Hmm. This is really weird because What I did was the same. I installed a fresh 3.0.3.9 then instantly upgraded to 3.1.0.12 then to 3.2.0.12 and didn't have any of these issues. The only difference that I installed all of these in an extra rom in a multirom environment. But this shouldn't make any difference.
I suggest you to stay on 3.1.0.12 then. If I remember you said earlier everything worked fine on this version. Honestly there is not so much difference between 3.2.0.12 and 3.1.0.12.
(Until finalize/stabilize my build, time to time I still boot into my 2.0.4.13 installation which is much older than 3.1.0.12 but still quite stable for everyday use.)