That is a "feature", that I think should be disabled by default. Press in the Menu Bar and open Settings screen. You'll see an option where you can choose what to do when exiting the player, choose "stop playing" and it's done.