I noticed I had hidden folders in my music folders. Enable "view hidden files and folders" on Windows/Linux and delete them.

You might have to delete them on your computer's harddisk and transfer the stuff over again. With the N900 I got into a weird reappearing loop where stuff deleted just came back soon after deletion.