I had this issue with my N950. The pins INSIDE the headphones may be not so tight as before. So when you jiggle the headphone jack a bit, the phone thinks that you've pulled out the headphones.

I had to open up the device and push the pins back in again with something pointy.

Those are the things that you have to bend inside so it will be tight again: