The RTC doesn't require the main processor to be on. With a flat battery (flat as your device cannot even start to tell you that the battery is discharged) the RTC can still go on for ages. So it's far better to _not_ remove the battery.

And anyway never do it with the device on.