Unfortunately,no there is no other workaround than to set it after the phone call again. The telephone app is too broken and ignorant