Which visuals are you trying to use? I don't have any visualizations installed other than the two that come with the base xmms install (Blur Scope and Simple spectrum analyzer), but both of those work okay.