Hmm. There is a bug in Xbmc that if you close it, it doesn't free the remote control port (9999). If you restart immediately after it, it doesn't work. Then you have to wait for a few minutes and restart xbmc again to make it work. Try this. You can also run xbmcremote with "-d connection" to print more debug output about the connection.