If you have one of those weird phobias like paranoia or persecution phobia you should go to a doctor but to avoid a panic attack in the meantime...
Even though there are some people here that will claim contacts synchronization is a privacy issue, it is not.