If the headset and both other devices are on, doing that will only ever connect it to whichever one it connected to last.