To me it sounds like the main issue is when you have a contact with multiple numbers, you would like to be able to switch which number you reply to? Does that sound correct?