I've managed to get similar behaviour by quickly tapping the "settings" button multiple times, resulting in more than one settings dialog. Changing things in one dialog and closing it would apply them, quitting the program would then save the old settings still in other dialogs...

Could this be behind it? Are there any other windows open after clicking settings? (maybe in background?)