I've been charging my N900 with that adapter connected to my old N95 charger for a few hours now and it's not even slightly hot, I'll keep track of its temperature tonight but I think you've gotten a faulty one.

You should contact Nokia, I don't thing they'll make a big deal of it, they we're really easy when it came to repairing my N95 some time ago