I don't have an N810, so I can't comment much on your problem. But I can say that there are two .Xmodmap files, one for the N810 and one for the N800. Perhaps you could switch to the N800 one for your external keyboard? The two files should be clearly named in your home directory...