It sounds like you might be having the issues with the mp4 format that most video podcasts are in.
Last I saw, the only real way of getting it to work was transcoding to another format.