Sorry, I don't think it's quite that simple. There are several servers available in the extras repositories. Any of these servers could contain exploits that would allow others to connect to your phone. It becomes a question of how up to date these applications are and how secure their upstream project is.

Also, even perfect server applications with no exploits rely on your root password being reasonably picked to not be susceptible to a dictionary attack.

Hope this helps.

Frank