I had a look at the taglib and if it's the only way to read ogg stuff, I may rely on that. Of course, provided that it is fast enough.
I already use two id3 libs, so I could always use a third as well.
I'm curious why there is no purely python based lib for reading the comments.