I manage a ton of websites. One of them. SuperCars.com, gets most of its content from custom XML feeds. Duplicate content often gets created because of what I believe is a deficiency in the Feeds module. Regardless of the cause, the content is there and needs to be dealt with. I finally found a module that helps with my problem. Dedupe is a "sandbox" project, so make sure to test before you use it.