I've found out that by dropping the audio bitrate to 64kbps, I can increase the video bitrate to the point where it starts dropping frames whilst keeping the audio smooth and in synch (VBR changed up to 300kbps).