On my unit the screen lights up white initially when you plug in the power adapter and it's off. You should have a tiny battery charging icon in the middle of the white screen.

To power the unit up in this state I have to hold down the power button for a few seconds before the Nokia logo appears and the loading bar should appear shortly after that.

Normally I leave the unit on all the time, and plug in the charger with the cover closed when needed.