How to remove duplicate domains ?

[intruder2600]

Hi,

I'm harvesting some domains and I have lots of duplicates, is it possible to check domain if it's already in txt file ?

 

[lokiys]

Hi,

I'm harvesting some domains and I have lots of duplicates, is it possible to check domain if it's already in txt file ?

Sure Rafal.
Choose action working with lists and then delete duplicates.

Cheers

 

[intruder2600]

Thx, but this will remove duplicate entries, not duplicate domains

 

[rostonix]

Then do not store anything except domains in list