To remove the association, open the address/phone book, find the contact and click the photo to start edit the details. At the bottom there should be "web link" looking like http://www.facebook.com/....... - you basically remove that contact field and the association is gone.