Both before and after the firmware update, I have had a problem similar to yours. Mine will start from off just fine if it is off the charger, but if it is on the charger or if it has been taken off the charger in the last 30 seconds or so, then pushing the center top button doesn't result in the white LED coming on and subsequent attempts after that will fail until I pull the battery.

If I take it off the charger and let it sit for a minute or so, then I can start it normally.

Frankly I was hoping the new kernel in the update would have fixed this problem.