I have switched to using exaile, which is a GTK clone of amarok. Works quite well ... and gives me the control I want. I manually decide when to refresh my directories and it seems to work fine.