Remove Duplicates from HTTP

Hi all

Im new here… had to post this as I couldnt find any solution to this…have been Google for days .. Huh

Anyway heres my problem

Im using HTTP link as my video sources; multiple links from different web

The problem is that I can only scrape from them so I cannot add or remove any movies from here

So naturally my movie collections have duplicates all over…

I have read the only solution is to remove the file manually; but the collection i have now is more thank 5k movies

impossible to manually remove them Sad

Is there a solution to this?

Was thinking to manually export the library andthen manually remove them in PC and then reimport them back… but i dont really know how…. any pointers greatly appreciated Angel