Are you sure it's actually on speaker mode and it's not just the volume of the earpiece set to high/maximum.

On speaker mode, the stereo speakers on the sides of the phone will produce the sound. Normally, only the earpiece will produce sound.