Mysterious Post-processing issues

Post any problems / bugs / issues that are Mylar-related in here.
Post Reply
Bigfireq
Posts: 25
Joined: Sat May 05, 2018 3:22 am

Mysterious Post-processing issues

Post by Bigfireq »

I have Mylar using QBittorrent to download most of my files. I have it set to give it the label Comics, and for the "Qbittorrent folder" I have it set to e:\mylar\automatic.

In "Quality & Post-processing", I have Enable post processing set with Move as the option, i have enable folder monitoring set, and it's watching e:\mylar\automatic.

When I look in e:\mylar\automatic, I have around 400 comics saved up. I don't see them being processed, and when I go to Manage, then Manual Post Processing, I see, once again, e:\mylar\automatic set to the folder correctly.

Here's the issue: When I hit Go Manual Run!, I get the following in my log:
[POST-PROCESSING] Manual post-processing completed for 2 issues.

This happens every time I run it. No errors reported, it's like it's just not seeing the files there.

Any idea? I can't figure out why it's not running for the majority of the files. It feels like there's a setting off, but I can't find it for the life of me.
Bigfireq
Posts: 25
Joined: Sat May 05, 2018 3:22 am

Re: Mysterious Post-processing issues

Post by Bigfireq »

Sorry, forgot to post the environment:

Mylar Version: development
-- git build 78d84eee5ed36589ec91e7f742383161e35f9f42.

I'm using Qbitorrent, latest release for downloading

There are no errors in the log. Here are the lines right before it says it's completed post-processing for only two files:

03-May-2018 05:57:56 - INFO :: mylar.run.2358 : Thread-27 : [FOLDER-CHECK] Checking folder E:\Mylar\Automatic for newly snatched downloads
03-May-2018 05:57:56 - INFO :: mylar.traverse_directories.1177 : Thread-27 : there are 5 files.
03-May-2018 05:57:56 - INFO :: mylar.Process.378 : Thread-27 : I have located 5 files that I should be able to post-process. Continuing...
03-May-2018 05:57:56 - INFO :: mylar.Process.410 : Thread-27 : [POST-PROCESSING] Alternate series naming detected: Dark Nights
03-May-2018 05:57:56 - INFO :: mylar.duplicate_filecheck.2087 : Thread-27 : [DUPECHECK] Duplicate check for E:\Mylar\Automatic\Dark Nights - The Metal 01 (Of 06) (2017) (Webrip) (The Last Kryptonian-DCP).cbr
03-May-2018 05:57:56 - INFO :: mylar.duplicate_filecheck.2113 : Thread-27 : [DUPECHECK] Existing Status already set to Downloaded
03-May-2018 05:57:56 - INFO :: mylar.duplicate_filecheck.2139 : Thread-27 : [DUPECHECK] Existing file within db :Dark Nights Metal 001 (2017).cbz has a filesize of : 45183410 bytes.
03-May-2018 05:57:56 - INFO :: mylar.duplicate_filecheck.2202 : Thread-27 : [DUPECHECK-FILESIZE PRIORITY] [#1] Retaining currently scanned in filename : Dark Nights Metal 001 (2017).cbz
03-May-2018 05:57:56 - INFO :: mylar.duplicate_filecheck.2087 : Thread-27 : [DUPECHECK] Duplicate check for E:\Mylar\Automatic\Doomsday Clock 01 (of 12) (2018) (Webrip) (The Last Kryptonian-DCP).cbr
03-May-2018 05:57:56 - INFO :: mylar.duplicate_filecheck.2113 : Thread-27 : [DUPECHECK] Existing Status already set to Downloaded
03-May-2018 05:57:56 - INFO :: mylar.duplicate_filecheck.2139 : Thread-27 : [DUPECHECK] Existing file within db :Doomsday Clock 001 (2018).cbz has a filesize of : 48840514 bytes.
03-May-2018 05:57:56 - INFO :: mylar.duplicate_filecheck.2202 : Thread-27 : [DUPECHECK-FILESIZE PRIORITY] [#1] Retaining currently scanned in filename : Doomsday Clock 001 (2018).cbz
03-May-2018 05:57:56 - INFO :: mylar.Process.1259 : Thread-27 : [POST-PROCESSING] Manual post-processing completed for 2 issues.
03-May-2018 05:57:56 - INFO :: mylar.run.2361 : Thread-27 : [FOLDER-CHECK] Finished checking for newly snatched downloads
03-May-2018 05:57:59 - INFO :: mylar.search_init.376 : Thread-12 : findit: {'status': False}
03-May-2018 05:57:59 - INFO :: mylar.search_init.380 : Thread-12 : Finished searching via :api. Issue not found - status kept as Wanted.
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Mysterious Post-processing issues

Post by evilhero »

Try enabling debug mode prior to performing a post-process (go to the Logs tab, upper right hand corner click on the 'Toggle Debug Logging' button).

Mylar won't be able to move any files from your seeding folder if it doesn't have the right permissions to move things out of (ie. it's not in the ownership group). Depending on how locked down it is, it might not be able to read any of the files either.

The 2 files it's continually post-processing is because you already have them within Mylar and in a Downloaded state. So it won't post-process them again - and because you don't have duplicate dump folder enabled, it won't move them out of the given location so that it doesn't keep on happening. As to why the others aren't being picked up - it could be any number of reasons, not limited to:
- if the series doesn't exist on your watchlist, it won't even attempt to post-process
- if it can't properly parse the filename, it won't be able to post-process them
- Mylar only tracks cbr and cbz files (webp too if I recall). Any other format is ignored.

If you post the debug log, it should provide more insight as to what's actually occurring underneath the hood.
Bigfireq
Posts: 25
Joined: Sat May 05, 2018 3:22 am

Re: Mysterious Post-processing issues

Post by Bigfireq »

Thanks. I turned on the debug mode, still not getting any errors. I made sure that the files weren't read-only. It's almost like it's ignoring the current state of its Wanted files when it's running the post-processing. Right now there are 450 issues in the folder, all called by Mylar which downloaded it via QBittorrent.

Before I ran the post-process, I went ahead and updated Mylar to the current build, relaunched it, and immediately ran post-processing. (Also, if there's a better way to attach the log rather than just posting snippets of it here, let me know.)

06-May-2018 11:14:40 - INFO :: mylar.dbUpdate.348 : Thread-14 : Update complete
06-May-2018 11:15:41 - INFO :: mylar.main.329 : MAIN : Received signal: shutdown
06-May-2018 11:15:50 - INFO :: mylar.halt.1118 : MAIN : Shutting down the background schedulers...
06-May-2018 11:15:50 - INFO :: mylar.shutdown.1151 : MAIN : Mylar is shutting down...
06-May-2018 11:16:05 - INFO :: mylar.initialize.175 : MainThread : Checking to see if the database has all tables....
06-May-2018 11:16:05 - INFO :: mylar.csv_load.1092 : MainThread : Populating Base Exception listings into Mylar....
06-May-2018 11:16:05 - INFO :: mylar.csv_load.1094 : MainThread : Populating Custom Exception listings into Mylar....
06-May-2018 11:16:05 - INFO :: mylar.dbcheck.1038 : MainThread : Ensuring DB integrity - Removing all Erroneous Comics (ie. named None)
06-May-2018 11:16:05 - INFO :: mylar.dbcheck.1040 : MainThread : Correcting Null entries that make the main page break on startup.
06-May-2018 11:16:05 - INFO :: mylar.initialize.189 : MainThread : Successfully discovered local IP and locking it in as : 192.168.0.66
06-May-2018 11:16:05 - INFO :: mylar.initialize.241 : MainThread : Remapping the sorting to allow for new additions.
06-May-2018 11:16:05 - INFO :: mylar.ComicSort.754 : MainThread : Sucessfully ordered 85 series in your watchlist.
06-May-2018 11:16:05 - INFO :: mylar.validateAndCreateDirectory.1348 : MainThread : [DIRECTORY-CHECK] Found comic directory: c:\Mylar
06-May-2018 11:16:05 - INFO :: mylar.initialize.72 : MAIN : Starting Mylar on http://0.0.0.0:8090/
06-May-2018 11:16:06 - INFO :: mylar.getVersion.119 : MAIN : Branch detected & set to : development
06-May-2018 11:16:06 - INFO :: mylar.versionload.309 : MAIN : Version information: development [78d84eee5ed36589ec91e7f742383161e35f9f42]
06-May-2018 11:16:06 - INFO :: mylar.start.374 : MAIN : [POST-PROCESS-QUEUE] Post Process queue enabled & monitoring for api requests....
06-May-2018 11:16:06 - INFO :: mylar.start.377 : MAIN : [POST-PROCESS-QUEUE] Succesfully started Post-Processing Queuer....
06-May-2018 11:16:06 - INFO :: mylar.start.387 : MAIN : [WEEKLY] Checking for existance of Weekly Comic listing...
06-May-2018 11:16:06 - INFO :: mylar.start.441 : MAIN : [FOLDER MONITOR] Enabling folder monitor for : E:\Mylar\Automatic every 5 minutes.
06-May-2018 11:16:06 - INFO :: mylar.start.447 : MAIN : Firing up the Background Schedulers now....
06-May-2018 11:16:06 - INFO :: mylar.start.451 : MAIN : Background Schedulers successfully started...
06-May-2018 11:16:17 - INFO :: mylar.main.329 : MAIN : Received signal: update
06-May-2018 11:16:27 - INFO :: mylar.halt.1118 : MAIN : Shutting down the background schedulers...
06-May-2018 11:16:27 - INFO :: mylar.shutdown.1153 : MAIN : Mylar is updating...
06-May-2018 11:16:31 - INFO :: mylar.shutdown.1164 : MAIN : Mylar is restarting...
06-May-2018 11:16:31 - INFO :: mylar.shutdown.1172 : MAIN : Restarting Mylar with ['c:\\Python27\\python.exe', 'c:\\Mylar\\Mylar.py']
06-May-2018 11:16:45 - INFO :: mylar.initialize.175 : MainThread : Checking to see if the database has all tables....
06-May-2018 11:16:45 - INFO :: mylar.csv_load.1092 : MainThread : Populating Base Exception listings into Mylar....
06-May-2018 11:16:45 - INFO :: mylar.csv_load.1094 : MainThread : Populating Custom Exception listings into Mylar....
06-May-2018 11:16:45 - INFO :: mylar.dbcheck.1038 : MainThread : Ensuring DB integrity - Removing all Erroneous Comics (ie. named None)
06-May-2018 11:16:45 - INFO :: mylar.dbcheck.1040 : MainThread : Correcting Null entries that make the main page break on startup.
06-May-2018 11:16:45 - INFO :: mylar.initialize.189 : MainThread : Successfully discovered local IP and locking it in as : 192.168.0.66
06-May-2018 11:16:45 - INFO :: mylar.initialize.241 : MainThread : Remapping the sorting to allow for new additions.
06-May-2018 11:16:45 - INFO :: mylar.ComicSort.754 : MainThread : Sucessfully ordered 85 series in your watchlist.
06-May-2018 11:16:45 - INFO :: mylar.validateAndCreateDirectory.1348 : MainThread : [DIRECTORY-CHECK] Found comic directory: c:\Mylar
06-May-2018 11:16:45 - INFO :: mylar.initialize.72 : MAIN : Starting Mylar on http://0.0.0.0:8090/
06-May-2018 11:16:46 - INFO :: mylar.getVersion.119 : MAIN : Branch detected & set to : development
06-May-2018 11:16:46 - INFO :: mylar.versionload.309 : MAIN : Version information: development [8d626ec36152996ba9791b52166385f6dfcda8a1]
06-May-2018 11:16:46 - INFO :: mylar.start.374 : MAIN : [POST-PROCESS-QUEUE] Post Process queue enabled & monitoring for api requests....
06-May-2018 11:16:46 - INFO :: mylar.start.377 : MAIN : [POST-PROCESS-QUEUE] Succesfully started Post-Processing Queuer....
06-May-2018 11:16:46 - INFO :: mylar.start.387 : MAIN : [WEEKLY] Checking for existance of Weekly Comic listing...
06-May-2018 11:16:46 - INFO :: mylar.start.441 : MAIN : [FOLDER MONITOR] Enabling folder monitor for : E:\Mylar\Automatic every 5 minutes.
06-May-2018 11:16:46 - INFO :: mylar.start.447 : MAIN : Firing up the Background Schedulers now....
06-May-2018 11:16:46 - INFO :: mylar.start.451 : MAIN : Background Schedulers successfully started...
06-May-2018 11:17:01 - INFO :: mylar.post_process.779 : CP Server Thread-4 : Starting postprocessing for : Manual Run
06-May-2018 11:17:01 - INFO :: mylar.traverse_directories.1177 : Thread-12 : there are 5 files.
06-May-2018 11:17:01 - INFO :: mylar.Process.382 : Thread-12 : I have located 5 files that I should be able to post-process. Continuing...
06-May-2018 11:17:01 - INFO :: mylar.Process.416 : Thread-12 : [POST-PROCESSING] Alternate series naming detected: Dark Nights
06-May-2018 11:17:01 - INFO :: mylar.duplicate_filecheck.2088 : Thread-12 : [DUPECHECK] Duplicate check for E:\Mylar\Automatic\Dark Nights - The Metal 01 (Of 06) (2017) (Webrip) (The Last Kryptonian-DCP).cbr
06-May-2018 11:17:01 - INFO :: mylar.duplicate_filecheck.2114 : Thread-12 : [DUPECHECK] Existing Status already set to Downloaded
06-May-2018 11:17:01 - INFO :: mylar.duplicate_filecheck.2143 : Thread-12 : [DUPECHECK] Existing file within db :Dark Nights Metal 001 (2017).cbz has a filesize of : 45183410 bytes.
06-May-2018 11:17:01 - INFO :: mylar.duplicate_filecheck.2206 : Thread-12 : [DUPECHECK-FILESIZE PRIORITY] [#1] Retaining currently scanned in filename : Dark Nights Metal 001 (2017).cbz
06-May-2018 11:17:01 - INFO :: mylar.duplicate_filecheck.2088 : Thread-12 : [DUPECHECK] Duplicate check for E:\Mylar\Automatic\Doomsday Clock 01 (of 12) (2018) (Webrip) (The Last Kryptonian-DCP).cbr
06-May-2018 11:17:01 - INFO :: mylar.duplicate_filecheck.2114 : Thread-12 : [DUPECHECK] Existing Status already set to Downloaded
06-May-2018 11:17:01 - INFO :: mylar.duplicate_filecheck.2143 : Thread-12 : [DUPECHECK] Existing file within db :Doomsday Clock 001 (2018).cbz has a filesize of : 48840514 bytes.
06-May-2018 11:17:01 - INFO :: mylar.duplicate_filecheck.2206 : Thread-12 : [DUPECHECK-FILESIZE PRIORITY] [#1] Retaining currently scanned in filename : Doomsday Clock 001 (2018).cbz
06-May-2018 11:17:01 - INFO :: mylar.Process.1275 : Thread-12 : [POST-PROCESSING] Manual post-processing completed for 2 issues.
06-May-2018 11:18:56 - INFO :: mylar.toggleVerbose.3576 : CP Server Thread-6 : Verbose (DEBUG) logging is enabled
06-May-2018 11:18:56 - DEBUG :: mylar.toggleVerbose.3577 : CP Server Thread-6 : If you can read this message, debug logging is now working
06-May-2018 11:19:03 - INFO :: mylar.post_process.779 : CP Server Thread-6 : Starting postprocessing for : Manual Run
06-May-2018 11:19:04 - DEBUG :: mylar.Process.342 : Thread-13 : [POST-PROCESSING] nzb name: Manual Run
06-May-2018 11:19:04 - DEBUG :: mylar.Process.343 : Thread-13 : [POST-PROCESSING] nzb folder: E:\Mylar\Automatic
06-May-2018 11:19:04 - DEBUG :: mylar.Process.347 : Thread-13 : [POST-PROCESSING] Not using SABnzbd : Manual Run
06-May-2018 11:19:04 - DEBUG :: mylar.Process.374 : Thread-13 : [POST-PROCESSING] Manual Run initiated
06-May-2018 11:19:04 - INFO :: mylar.traverse_directories.1177 : Thread-13 : there are 5 files.
06-May-2018 11:19:04 - DEBUG :: mylar.listFiles.142 : Thread-13 : [FILENAME]: Dark Nights - The Metal 01 (Of 06) (2017) (Webrip) (The Last Kryptonian-DCP).cbr
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.277 : Thread-13 : Scanner group tag discovered: The Last Kryptonian-DCP
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.428 : Thread-13 : Mini-Series Count detected. Maximum issue # set to : 6
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.431 : Thread-13 : Issue Number SHOULD BE: 01
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.360 : Thread-13 : checking date : 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.363 : Thread-13 : date: 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.614 : Thread-13 : datecheck: [{'date': '2017', 'position': 7, 'mod_position': 35}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.620 : Thread-13 : sctd: 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.629 : Thread-13 : year verified as : 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.635 : Thread-13 : year verified as: 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.658 : Thread-13 : highest_series_position: 7
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.664 : Thread-13 : possible_issuenumbers: [{'position': 5, 'validcountchk': False, 'number': '01', 'mod_position': 24}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.736 : Thread-13 : issue_position: 5
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.747 : Thread-13 : issue verified as : 01
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.855 : Thread-13 : ALT-SERIES NAME [ISSUE TITLE]: Dark Nights [The Metal]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.871 : Thread-13 : sf_highest_series_pos: ['Dark', 'Nights', '-', 'The', 'Metal']
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.903 : Thread-13 : series title possibly: Dark Nights - The Metal
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.909 : Thread-13 : Alternate series / issue title: Dark Nights [The Metal]
06-May-2018 11:19:04 - DEBUG :: mylar.listFiles.142 : Thread-13 : [FILENAME]: Doctor Aphra 013 (2017) (Digital) (Kileko-Empire).cbr
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.277 : Thread-13 : Scanner group tag discovered: Kileko-Empire
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.360 : Thread-13 : checking date : 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.363 : Thread-13 : date: 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.614 : Thread-13 : datecheck: [{'date': '2017', 'position': 3, 'mod_position': 17}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.620 : Thread-13 : sctd: 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.629 : Thread-13 : year verified as : 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.635 : Thread-13 : year verified as: 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.658 : Thread-13 : highest_series_position: 3
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.664 : Thread-13 : possible_issuenumbers: [{'position': 2, 'validcountchk': False, 'number': '013', 'mod_position': 13}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.736 : Thread-13 : issue_position: 2
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.747 : Thread-13 : issue verified as : 013
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.871 : Thread-13 : sf_highest_series_pos: ['Doctor', 'Aphra']
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.903 : Thread-13 : series title possibly: Doctor Aphra
06-May-2018 11:19:04 - DEBUG :: mylar.listFiles.142 : Thread-13 : [FILENAME]: Doctor Aphra 014 (2018) (Digital) (Kileko-Empire).cbr
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.277 : Thread-13 : Scanner group tag discovered: Kileko-Empire
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.360 : Thread-13 : checking date : 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.363 : Thread-13 : date: 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.614 : Thread-13 : datecheck: [{'date': '2018', 'position': 3, 'mod_position': 17}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.620 : Thread-13 : sctd: 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.629 : Thread-13 : year verified as : 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.635 : Thread-13 : year verified as: 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.658 : Thread-13 : highest_series_position: 3
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.664 : Thread-13 : possible_issuenumbers: [{'position': 2, 'validcountchk': False, 'number': '014', 'mod_position': 13}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.736 : Thread-13 : issue_position: 2
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.747 : Thread-13 : issue verified as : 014
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.871 : Thread-13 : sf_highest_series_pos: ['Doctor', 'Aphra']
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.903 : Thread-13 : series title possibly: Doctor Aphra
06-May-2018 11:19:04 - DEBUG :: mylar.listFiles.142 : Thread-13 : [FILENAME]: Doctor Aphra 015 (2017) (Digital) (Kileko-Empire).cbr
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.277 : Thread-13 : Scanner group tag discovered: Kileko-Empire
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.360 : Thread-13 : checking date : 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.363 : Thread-13 : date: 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.614 : Thread-13 : datecheck: [{'date': '2017', 'position': 3, 'mod_position': 17}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.620 : Thread-13 : sctd: 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.629 : Thread-13 : year verified as : 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.635 : Thread-13 : year verified as: 2017
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.658 : Thread-13 : highest_series_position: 3
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.664 : Thread-13 : possible_issuenumbers: [{'position': 2, 'validcountchk': False, 'number': '015', 'mod_position': 13}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.736 : Thread-13 : issue_position: 2
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.747 : Thread-13 : issue verified as : 015
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.871 : Thread-13 : sf_highest_series_pos: ['Doctor', 'Aphra']
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.903 : Thread-13 : series title possibly: Doctor Aphra
06-May-2018 11:19:04 - DEBUG :: mylar.listFiles.142 : Thread-13 : [FILENAME]: Doomsday Clock 01 (of 12) (2018) (Webrip) (The Last Kryptonian-DCP).cbr
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.277 : Thread-13 : Scanner group tag discovered: The Last Kryptonian-DCP
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.428 : Thread-13 : Mini-Series Count detected. Maximum issue # set to : 12
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.431 : Thread-13 : Issue Number SHOULD BE: 01
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.360 : Thread-13 : checking date : 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.363 : Thread-13 : date: 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.614 : Thread-13 : datecheck: [{'date': '2018', 'position': 4, 'mod_position': 26}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.620 : Thread-13 : sctd: 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.629 : Thread-13 : year verified as : 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.635 : Thread-13 : year verified as: 2018
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.658 : Thread-13 : highest_series_position: 4
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.664 : Thread-13 : possible_issuenumbers: [{'position': 2, 'validcountchk': False, 'number': '01', 'mod_position': 15}]
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.736 : Thread-13 : issue_position: 2
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.747 : Thread-13 : issue verified as : 01
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.871 : Thread-13 : sf_highest_series_pos: ['Doomsday', 'Clock']
06-May-2018 11:19:04 - DEBUG :: mylar.parseit.903 : Thread-13 : series title possibly: Doomsday Clock
06-May-2018 11:19:04 - INFO :: mylar.Process.382 : Thread-13 : I have located 5 files that I should be able to post-process. Continuing...
06-May-2018 11:19:04 - INFO :: mylar.Process.416 : Thread-13 : [POST-PROCESSING] Alternate series naming detected: Dark Nights
06-May-2018 11:19:04 - DEBUG :: mylar.Process.563 : Thread-13 : [POST-PROCESSING][ISSUE-VERIFY] Now checking against Dark Nights: Metal-103508
06-May-2018 11:19:04 - DEBUG :: mylar.Process.626 : Thread-13 : [POST-PROCESSING][ISSUE-VERIFY][Lone Volume MATCH] Volume label of None indicates only volume for this series on your watchlist.
06-May-2018 11:19:04 - DEBUG :: mylar.Process.651 : Thread-13 : [POST-PROCESSING][CLOCATION] E:\Mylar\Automatic
06-May-2018 11:19:04 - DEBUG :: mylar.Process.671 : Thread-13 : [POST-PROCESSING][SUCCESSFUL MATCH: Dark Nights: Metal-103508] Match verified for Dark Nights - The Metal 01 (Of 06) (2017) (Webrip) (The Last Kryptonian-DCP).cbr
06-May-2018 11:19:04 - DEBUG :: mylar.Process.563 : Thread-13 : [POST-PROCESSING][ISSUE-VERIFY] Now checking against Doomsday Clock-106286
06-May-2018 11:19:04 - DEBUG :: mylar.Process.572 : Thread-13 : [POST-PROCESSING][ISSUE-VERIFY] 2017-11-22 is before the issue year of 2018 that was discovered in the filename
06-May-2018 11:19:04 - DEBUG :: mylar.Process.581 : Thread-13 : [POST-PROCESSING][ISSUE-VERIFY] IssueYear (issyr) is 2018
06-May-2018 11:19:04 - DEBUG :: mylar.Process.586 : Thread-13 : [POST-PROCESSING][ISSUE-VERIFY] 2018 comparing to 2018 : rechecking by month-check versus year.
06-May-2018 11:19:04 - DEBUG :: mylar.Process.626 : Thread-13 : [POST-PROCESSING][ISSUE-VERIFY][Lone Volume MATCH] Volume label of None indicates only volume for this series on your watchlist.
06-May-2018 11:19:04 - DEBUG :: mylar.Process.651 : Thread-13 : [POST-PROCESSING][CLOCATION] E:\Mylar\Automatic
06-May-2018 11:19:04 - DEBUG :: mylar.Process.671 : Thread-13 : [POST-PROCESSING][SUCCESSFUL MATCH: Doomsday Clock-106286] Match verified for Doomsday Clock 01 (of 12) (2018) (Webrip) (The Last Kryptonian-DCP).cbr
06-May-2018 11:19:04 - DEBUG :: mylar.Process.957 : Thread-13 : [POST-PROCESSING] There are 2 files found that match on your watchlist, 0 files are considered one-off's, and 3 files do not match anything
06-May-2018 11:19:04 - INFO :: mylar.duplicate_filecheck.2088 : Thread-13 : [DUPECHECK] Duplicate check for E:\Mylar\Automatic\Dark Nights - The Metal 01 (Of 06) (2017) (Webrip) (The Last Kryptonian-DCP).cbr
06-May-2018 11:19:04 - INFO :: mylar.duplicate_filecheck.2114 : Thread-13 : [DUPECHECK] Existing Status already set to Downloaded
06-May-2018 11:19:04 - INFO :: mylar.duplicate_filecheck.2143 : Thread-13 : [DUPECHECK] Existing file within db :Dark Nights Metal 001 (2017).cbz has a filesize of : 45183410 bytes.
06-May-2018 11:19:04 - DEBUG :: mylar.duplicate_filecheck.2158 : Thread-13 : [DUPECHECK] Based on duplication preferences I will retain based on : filesize
06-May-2018 11:19:04 - INFO :: mylar.duplicate_filecheck.2206 : Thread-13 : [DUPECHECK-FILESIZE PRIORITY] [#1] Retaining currently scanned in filename : Dark Nights Metal 001 (2017).cbz
06-May-2018 11:19:04 - INFO :: mylar.duplicate_filecheck.2088 : Thread-13 : [DUPECHECK] Duplicate check for E:\Mylar\Automatic\Doomsday Clock 01 (of 12) (2018) (Webrip) (The Last Kryptonian-DCP).cbr
06-May-2018 11:19:04 - INFO :: mylar.duplicate_filecheck.2114 : Thread-13 : [DUPECHECK] Existing Status already set to Downloaded
06-May-2018 11:19:04 - INFO :: mylar.duplicate_filecheck.2143 : Thread-13 : [DUPECHECK] Existing file within db :Doomsday Clock 001 (2018).cbz has a filesize of : 48840514 bytes.
06-May-2018 11:19:04 - DEBUG :: mylar.duplicate_filecheck.2158 : Thread-13 : [DUPECHECK] Based on duplication preferences I will retain based on : filesize
06-May-2018 11:19:04 - INFO :: mylar.duplicate_filecheck.2206 : Thread-13 : [DUPECHECK-FILESIZE PRIORITY] [#1] Retaining currently scanned in filename : Doomsday Clock 001 (2018).cbz
06-May-2018 11:19:04 - INFO :: mylar.Process.1275 : Thread-13 : [POST-PROCESSING] Manual post-processing completed for 2 issues.
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Mysterious Post-processing issues

Post by evilhero »

Based on those logs, it can only find 5 files in the directory - what exactly is in the directory (

Code: Select all

E:\Mylar\Automatic
)? At the point of scanning the directory, the only thing it does is literally scan the directory to find files - it doesn't even look at what's Wanted or not, or what's even on your watchlist. It's just gathering the details of the directory and then it starts going thru thereafter checking things.

Are there symlinks/junctions in there - or is it a mounted drive ? Is everything in folders except for those 5 files it picks up ?
Bigfireq
Posts: 25
Joined: Sat May 05, 2018 3:22 am

Re: Mysterious Post-processing issues

Post by Bigfireq »

It wasn't a symbolic link or a junction, but that question put me on the right track. The problem turned out to be that it was a on a Drobo. I moved the folder off to a regular drive and bam, it processed through all the files. I have no idea why there would be a problem with the Drobo, and haven't had similar experiences, but it's all working now.
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Mysterious Post-processing issues

Post by evilhero »

Bigfireq wrote: Thu May 10, 2018 6:38 am It wasn't a symbolic link or a junction, but that question put me on the right track. The problem turned out to be that it was a on a Drobo. I moved the folder off to a regular drive and bam, it processed through all the files. I have no idea why there would be a problem with the Drobo, and haven't had similar experiences, but it's all working now.
Odds are the problem is a permissions problem if it's on a separate device and it can't access it, but can if it's moved to a local folder. When you access stuff across mounted filesystems, the permissions given to the folders default usually to the user mounting, or if you specify the uid/guid within the mount command. Odds are that the user who is running Mylar doesn't have the proper permissions to even be able to properly read the given directory on the DROBO, let alone move stuff - which would mean that the mylar user is not the owner of the given directory, nor within the group ownership of said directory. Simply adding the mylar user to the given group is normally enough to perform the operations that are required (cleanup might not work depending on how the system is setup, but then again it could work fine).
Bigfireq
Posts: 25
Joined: Sat May 05, 2018 3:22 am

Re: Mysterious Post-processing issues

Post by Bigfireq »

I'll bet you're right. I forgot about the fact that it's running as a service, and not necessarily as the user I'm logged in as.
Post Reply