We assume you've done the obvious of putting system volume on max (from the icon in the home screen system-tray?), and in mplayer used the hardware buttons to increase volume? (on the n800 this button is marked +).