Kath, just had a look as i've never tagged before. If you create a tag then choose the 'edit tags' option from settings then what ever pics is in that tag folder you remove then that should be it.

Edit...

Ah got you now lol, i can't get rid of the tag now either. What a donkey.