Deleting Tags on Indexed Files

I am having issues deleting tags on indexed files. Here is the issue: I am trying to delete a large number of garbage tags on files in an indexed folder. If in the sidebar, I delete the tags, then empty the trash selecting “Remove All Items”, the tag is not removed from the file in the finder and then shows back on the file in DT (after disappearing for few seconds). Is this expected behavior?

Thanks!