Actually, the "one username only makes it secure" is a myth. A username isn't a secret, and it shouldn't be treated as one. Yes, my username on my boxes is "slauwers". Yes, my boxes are exposed to the wild wild web.
As a conclusion though. If I find that I frequently need to access my home computer when I'm on the go. Well then I would open up my router for ssh. But for IRC which could be run as a client on the phone itself?
I just think you are better of with a defensive approach to security. And "a one-in-a-million event" of SSH getting cracked? I would say a one-in-fifty event, and still worry that I underestimate the risk.