beside the fact that it's slower than USB?
the fact that non or lamost non of audio players support them. I'm using sftp very much for some backup or photos or something like that. But transfering few GB of music song by song or album by album from my filemanager is just something I don't want to do.