Figured it out, for those who have the same problem, make sure you specify in your openal.conf in the order to try, alsa first. Sound is beautiful. I also dropped the sample rate to 22050 and left everything else at the defaults.