Block him. That's the solution. The contact reappears because you're still in that person's address book so Yappari reminds you of that.