Are you in silent mode? If so it won't work unless you add a little something to a file:
/etc/pulse/xpolicy.conf
[stream]
exe = "mplayer"
group = player


There's also a bug someplace.