OK, I'm still playing with this thing before I RMA it. Right now the device still won't power-on on it's own. However, if I plug it in it is now consistently going into Battery Recharge mode (after sitting plugged in for 30 or so sec), and can then be powered on from there.

I have a question: Has anybody who is experiencing these power-on problems tried replacing the battery, either with an official Nokia one or a Hong Kong knock-off? I'm kind of wondering if the problem with the battery itself, and that the battery isn't correctly registering with the device sometimes, causing it to think the battery is dead or something...