The mediaplayer starts where the indicator of how much is played ends. Do you see these purple lines in your gpodder?
Now I check for new episodes, manually select and download episodes (at home). After I have listen to an episode I usually delete it manually unless I want to keep it for longer.