Yes, you can do it (remove the battery, that is) with the device on. It's actually recommended at the last resort for a hung tablet. No ill -- beyond loss of what's in RAM -- has ever come from it.