apt-get remove xorg-evdev-mouse does the trick. How annoying that we either get mouse support or proper scrolling but not both. Anyway, apologies for going off topic.