You may not be holding it down long enough.

Really, you shouldn't be turning it off, anyway. It's designed to be left on at all times. Just keep it on the charger when you're at home and not using it.