Yeah, you've touched on one of my peeves too.

Some have told me they tap the edge of the device against their palm to knock the battery out. Others are using thin plastic utensils to pry them out. Regardless, that design could have been much better.