Mine does that when the battery doesn't have enough charge, and I am using a charger that doesn't appear to be a proper charger. So I plug it into a usb port for a while, turned off. Then it works.

Other than that, you might try taking out the SD card if you have one in.