Watched folders add items into the Library, and never remove them when you just remove a path as a watched folder.
You must manually remove items you don't want in the Library anymore. You probably want soft-delete (select the items, hit Delete, leave the first checkbox selected).