Manual Post-Processing/Manual Run not working

Post any problems / bugs / issues that are Mylar-related in here.
Warborg
Posts: 45
Joined: Sat Apr 16, 2016 7:01 pm

Manual Post-Processing/Manual Run not working

Post by Warborg »

I use Mylar constantly and normally love it, but it's giving me grief this morning. I've manually downloaded a bundle of the issues I collect and placed them in my designated Import_COMICS directory and then tried to do a manual run. Normally this works fine, it grabs all the issues it needs out of the import folder and everything is just fine. I did notice the other day when adding comics it wasn't populating the issues, but I figured that might have been an issue on the back end and I know that can update later so I just left it alone. I noticed this morning it still wasn't showing issues but I was a few commits behind, so I stopped the service and did a git pull that updated it (and just to make sure it didn't miss anything after I saw the problem, I did another couple pulls and it says it's up to date) and now the manual import isn't working at all. I've included my info below including a snip of the log after I tried to do a manual run. Also, I still get that issue where Sab will download and then run the processing script and end up hanging so Sab will stop processing downloads altogether until I restart it's service. I did make sure that the "Enable Completed Download Handling" was disabled in the downloader/Sab settings.

Running on Windows Home Server 2011

Version: 0fe8ab7ad87e0814de5bffcbed8224b03d3c8229 (development)

2018-06-20 10:11:06 INFO pausing for 60 seconds before continuing to avoid hammering
2018-06-20 10:11:06 INFO Shhh be very quiet...I'm looking for Agent 47 Birth of the Hitman issue: 6 (2018) using OMGWTFNZBS (newznab).
2018-06-20 10:11:06 INFO Alternate Search pattern detected...re-adjusting to : Agent 47 Birth of the Hitman
2018-06-20 10:11:06 WARNING Connection error trying to retrieve data from newznab: ('Connection aborted.', error(10060, 'A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond'))
2018-06-20 10:10:50 ERROR Uncaught exception: Traceback (most recent call last):
File "C:\Mylar\mylar\logger.py", line 336, in new_run
old_run(*args, **kwargs)
File "C:\Python27\lib\threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "C:\Mylar\mylar\PostProcessor.py", line 589, in Process
if int(isc['IssueDate'][:4]) < int(x['issue_year']):
KeyError: 'issue_year'
2018-06-20 10:10:50 INFO temploc: 604
2018-06-20 10:10:49 INFO temploc: 021
2018-06-20 10:10:49 INFO temploc: 704
2018-06-20 10:10:49 INFO temploc: 158
2018-06-20 10:10:49 INFO temploc: 020
2018-06-20 10:10:49 INFO [POST-PROCESSING] Alternate series naming detected: Ben Reilly
2018-06-20 10:10:49 INFO temploc: 016
2018-06-20 10:10:49 INFO temploc: 006
2018-06-20 10:10:49 INFO loopchk: [u'BattlestarGalactica|BSGvsBSG']
2018-06-20 10:10:49 WARNING Battlestar Galactica [1979] is either Paused or in an Ended status with 100% completion. Ignoring for match.
2018-06-20 10:10:49 INFO [POST-PROCESSING] Alternate series naming detected: Battlestar Galactica
2018-06-20 10:10:49 INFO temploc: 049
2018-06-20 10:10:49 WARNING Batman [2011] is either Paused or in an Ended status with 100% completion. Ignoring for match.
2018-06-20 10:10:49 INFO temploc: 02
2018-06-20 10:10:49 WARNING Batman [2011] is either Paused or in an Ended status with 100% completion. Ignoring for match.
2018-06-20 10:10:49 INFO [POST-PROCESSING] Alternate series naming detected: Batman
2018-06-20 10:10:49 INFO temploc: 010
2018-06-20 10:10:49 INFO temploc: 010
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Manual Post-Processing/Manual Run not working

Post by evilhero »

Did you restart Mylar after you made the change to not enable Completed Download Handling (CDH)?

It's just come up that disabling/enabling the option will not turn off/turn on the CDH properly as far as monitoring. So if you had it enabled previously, and disabled it - it would still be running it the background and could possibly be affecting things in regards to post-processing conflicts. The 'fix' at this point (as it has yet to be addressed), is to restart Mylar after you enable/disable CDH and saved the config. Doing so will ensure that Mylar can either load/not load the required backend stuff properly.

Saw the error before in regards to the post-processing with someone else, but I literally haven't hit it myself so I just forgot about it (as it wasn't an issue for it, was just mentioned in passing). Have it fixed in my local repo, and will be pushing it out soon (just trying to finish some other post-processing related problems at the same time).
Warborg
Posts: 45
Joined: Sat Apr 16, 2016 7:01 pm

Re: Manual Post-Processing/Manual Run not working

Post by Warborg »

Cool, waiting (im)patiently for that patch... :) As to the CDH, I've had it disabled for some time and have been through multiple restarts since.
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Manual Post-Processing/Manual Run not working

Post by evilhero »

Fix is now live in development. Give it a shot, and see if that fixes things for you (it'll fix the issue_year error you mentioned at the very least) - hopefully other items too.
Warborg
Posts: 45
Joined: Sat Apr 16, 2016 7:01 pm

Re: Manual Post-Processing/Manual Run not working

Post by Warborg »

Well, I tried a manual run again and it's still not importing, and here is a snip of the log:

2018-06-20 11:56:29 INFO Completed Queueing API Search scan
2018-06-20 11:56:29 INFO adding: ComicID:100603 IssueiD: 674147
2018-06-20 11:56:29 INFO returning false
2018-06-20 11:56:29 INFO adding: ComicID:86343 IssueiD: 674129
2018-06-20 11:56:29 INFO returning false
2018-06-20 11:56:29 INFO adding: ComicID:89380 IssueiD: 674138
2018-06-20 11:56:29 INFO returning false
2018-06-20 11:56:29 INFO adding: ComicID:85311 IssueiD: 674137
2018-06-20 11:56:29 INFO returning false
2018-06-20 11:56:29 INFO adding: ComicID:25922 IssueiD: 153181
2018-06-20 11:56:29 INFO returning false
2018-06-20 11:56:29 INFO adding: ComicID:25922 IssueiD: 153180
Warborg
Posts: 45
Joined: Sat Apr 16, 2016 7:01 pm

Re: Manual Post-Processing/Manual Run not working

Post by Warborg »

This time, I cleared the log and then immediately did a manual run and then switched back quick to check the log, and this is the result:

2018-06-20 11:58:47 INFO temploc: 001
2018-06-20 11:58:47 INFO temploc: 001
2018-06-20 11:58:47 INFO [POST-PROCESSING] Alternate series naming detected: Infinity Countdown
2018-06-20 11:58:47 INFO temploc: 001
2018-06-20 11:58:47 INFO temploc: 001
2018-06-20 11:58:47 INFO [POST-PROCESSING] Alternate series naming detected: Infinity Countdown
2018-06-20 11:58:47 INFO temploc: 002
2018-06-20 11:58:47 INFO temploc: 002
2018-06-20 11:58:46 INFO [POST-PROCESSING] Alternate series naming detected: Hunt for Wolverine
2018-06-20 11:58:46 WARNING Harley Quinn [2013] is either Paused or in an Ended status with 100% completion. Ignoring for match.
2018-06-20 11:58:46 INFO temploc: 049
2018-06-20 11:58:46 INFO temploc: 002
2018-06-20 11:58:46 INFO temploc: 002
2018-06-20 11:58:46 INFO temploc: 604
2018-06-20 11:58:46 INFO temploc: 021
2018-06-20 11:58:46 INFO temploc: 704
2018-06-20 11:58:46 INFO temploc: 158
2018-06-20 11:58:46 INFO temploc: 020
2018-06-20 11:58:46 INFO [POST-PROCESSING] Alternate series naming detected: Ben Reilly
2018-06-20 11:58:46 INFO temploc: 016
2018-06-20 11:58:46 INFO temploc: 006
2018-06-20 11:58:46 INFO loopchk: [u'BattlestarGalactica|BSGvsBSG']
2018-06-20 11:58:46 WARNING Battlestar Galactica [1979] is either Paused or in an Ended status with 100% completion. Ignoring for match.
2018-06-20 11:58:46 INFO [POST-PROCESSING] Alternate series naming detected: Battlestar Galactica
2018-06-20 11:58:46 INFO temploc: 049
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Manual Post-Processing/Manual Run not working

Post by evilhero »

Make sure to enable debug mode (via the logs tab) prior to starting the post-processing. The info level logs don't provide enough information to troubleshoot.

Also the log posted was for searching, not for post-processing (well the initial one).

Do the series you're trying to manually post-process exist on your watchlist?

And you updated your version of mylar to the most recent (if you're running dev, if you're running master fix isn't there)
Warborg
Posts: 45
Joined: Sat Apr 16, 2016 7:01 pm

Re: Manual Post-Processing/Manual Run not working

Post by Warborg »

I am running dev and I did update it. I've been trying to catch it when it's searching the imports instead of trying to search... Now it's unjammed somewhat and imported a large chunk of the comics, but there are a few left in the directory that it's been downloading/importing for the past several months (and yes, they are in my watch list). I noticed one of them is Stargate Universe, and I saw this in the log after running the manual run:

2018-06-20 12:11:35 INFO temploc: 005
2018-06-20 12:11:35 INFO loopchk: [u'StargateUniverse']
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Manual Post-Processing/Manual Run not working

Post by evilhero »

K I'm a bit confused just with the terminology differences. Import is not the same as post-processing. Import is from the "import a directory" option under the Manage tab. Post-processing is the "Manual post-processing" option under the Manage tab. Totally different items, which I'm pretty sure you're doing a manual pp, but again just the terms are messing me up trying to follow along.

And again, debug logs are needed. Posting the INFO level stuff when trying to troubleshoot is next to impossible to use as it's lacking all the pertinent information.
Warborg
Posts: 45
Joined: Sat Apr 16, 2016 7:01 pm

Re: Manual Post-Processing/Manual Run not working

Post by Warborg »

Ok, sorry for confusing... I'm doing the mpp. So it turns out that when it started working it grabbed everything I made available except for 3-4 items. Of those items, it seems like the individual comics didn't update showing there was a new issue (so if I was trying to get it to process issue 5, I'd look at the comic in Mylar and it would only show issues 1-4 available and those were all complete). I did a refresh on each comic and then they popped up with the new wanted issue, and the mpp picked them up. The ONLY one that it refuses to pick up is Stargate Universe, and I did the refresh and everything and it shows the newest issue as wanted, but still won't pick it up. Here is that section of the debug log:

2018-06-20 12:24:56 DEBUG Sun, 16 Oct 2016 01:21:45 -0400 is before store date of 2018-06-20. Ignoring search result as this is not the right issue.
2018-06-20 12:24:56 DEBUG [CONV]pubdate: 2016-10-16 < storedate: 2018-06-19
2018-06-20 12:24:56 DEBUG size given as: 185.6 MB
2018-06-20 12:24:56 DEBUG comsize_b: 194630348
2018-06-20 12:24:56 INFO temploc: 005
2018-06-20 12:24:56 DEBUG sub:[COMIC] Batman 13 - Jeder stirbt fuer sich allein 3.cbr
2018-06-20 12:24:56 DEBUG [FILECHECKER] StargateUniverse - watchlist match on : Stargate Universe 005 (2018) (Digital) (Kileko-Empire).cbr
2018-06-20 12:24:56 DEBUG checking search result: [COMIC] Batman 13 - Jeder stirbt fuer sich allein 3.cbr
2018-06-20 12:24:56 DEBUG [FILECHECKER] StargateUniverse - watchlist match on : Stargate Universe 005 (2018) (Digital) (Kileko-Empire).cbr
2018-06-20 12:24:56 DEBUG Sun, 16 Oct 2016 01:21:44 -0400 is before store date of 2018-06-20. Ignoring search result as this is not the right issue.
2018-06-20 12:24:56 INFO loopchk: [u'StargateUniverse']
2018-06-20 12:24:56 DEBUG [CONV]pubdate: 2016-10-16 < storedate: 2018-06-19
2018-06-20 12:24:56 DEBUG size given as: 204.7 MB
2018-06-20 12:24:56 DEBUG comsize_b: 214676912
2018-06-20 12:24:56 DEBUG sub:[COMIC] Batman 16 - Doppelspiel.cbr
2018-06-20 12:24:56 DEBUG checking search result: [COMIC] Batman 16 - Doppelspiel.cbr
2018-06-20 12:24:56 DEBUG Fri, 14 Oct 2016 21:09:41 -0400 is before store date of 2018-06-20. Ignoring search result as this is not the right issue.
2018-06-20 12:24:56 DEBUG [CONV]pubdate: 2016-10-14 < storedate: 2018-06-19
2018-06-20 12:24:56 INFO I have located 1 files that I should be able to post-process. Continuing...
2018-06-20 12:24:56 DEBUG size given as: 57.0 MB
2018-06-20 12:24:56 DEBUG series title possibly: Stargate Universe
2018-06-20 12:24:56 DEBUG comsize_b: 59817582
2018-06-20 12:24:56 DEBUG sf_highest_series_pos: ['Stargate', 'Universe']
Post Reply