maybe don't pair the phones in first place? I know that is not what you asked for but for security aspects this should be quite a barrier, isn't it? But your question sure is relevant as you don't want to open your entire home directory to every person you share a file with.