I use http://id3-py.sourceforge.net/
ID V1 tags
and
http://nedbatchelder.com/code/modules/id3reader.html
for the rest.

I've also found some ogg libs in pure python. Might be easier to use than a separate component. I'll try them first ...

Pure python always translates nicely to absolute portability between platforms. As, e.g. I currently develop purely on osx and test it by running it in a window. (music playing is then done through pygame -(which, by the way, also supports ogg).