Yes, that's where Tear stores its settings and bookmarks. Deleting that file should remove them.

Or install tear-bookmarks (I think that's the name) from either the Extras or Extras-Devel repository (I forget which). It will give you a program for adding and removing individual bookmarks.