Duplicate Prevention
-
- Posts: 3
- Joined: Thu Aug 29, 2019 9:11 pm
Duplicate Prevention
Instead of dumping duplicates into a Duplicates folder, is there an option to simply NOT download duplicates? I mean, if a duplicate is detected, is there a way to then skip downloading it? Or just trash it all together, if the duplicate detection takes place after download...
- evilhero
- Site Admin
- Posts: 2894
- Joined: Sat Apr 20, 2013 3:43 pm
- Contact:
Re: Duplicate Prevention
The duplicate detection takes place after the download, as it's done during the post-process phase of the workflow (search, download, post-process, cleanup). In order for it to not download the duplicate it would have to be done at the search phase, which I mean it could theoretically do it - it just would add some additional complexity to the workflow model due to all the different methods that are available for searching.kevintothecore wrote: ↑Mon Sep 09, 2019 4:45 pm Instead of dumping duplicates into a Duplicates folder, is there an option to simply NOT download duplicates? I mean, if a duplicate is detected, is there a way to then skip downloading it? Or just trash it all together, if the duplicate detection takes place after download...
I do like the idea however, of just not downloading it due to it hitting a duplication match - however there are a lot of hurdles to overcome with this method, mainly due to how the search operates. During the post-process phase, it's definitely easier to just wipe the download if it's a duplicate (I thought that's what actually happens when you turn off the duplicates folder option - but it's been ages since I last looked at that portion of code)
-
- Posts: 3
- Joined: Thu Aug 29, 2019 9:11 pm
Re: Duplicate Prevention
Oooh, excellent. Toggling the Duplicates folder option would be the best solution then. Thanks