You can also open the phone app and choose "Select contact" and it will only show contacts with a phone number set, just like the IM conversations contact list will only show people who've been added from an IM service.