It would be possible yes, but making sure each contact does not have a phone number would be a bit expensive in processing power (at least in the way it's currently handled) - I think adding a searchbar would suffice, even though contacts without a number would show up?