Well, speakerphone mode would be using it with neither BT nor wired headphones.

Unless your cans have a non-standard connector, it should be able to tell there's no mic, and work properly.

Workaround would be to use alsamixer to unmute the internal mic after plugging the phones in, but AFAIK, alsamixer's only been made to work in Debian.