I don't know where the battery is located at on the N900, but this is how it would look like:
That's the picture of a backup battery on the 2004 released Nokia 6230 (which I also owned).
Today, I asked a Nokia Service Center to replace it, but they said that they'd have to send it to Nokia to fix it!