Uninstall tracker

Please note that it has a lot of dependencies including the stock media player and picture viewer. You will need to find alternatives.

Your problem looks strange. Tracker should only rebuild databases when it notices a change in watched folders. Perhaps it is misconfigured? Check out this thread for ideas and/or install tracker-cfg from extras.