Thanks for that tip! I now have sudo set to ask for the user's password and use passphrases for all my keys... I don't know if I am just too paranoid or a sucker for punishment.

I don't have it ask for a password when you log in, though. I am security lax; my password and passphrase are not even all that different.