errors post processing ComicRN

Post any problems / bugs / issues that are Mylar-related in here.
Post Reply
fruitfrog
Posts: 2
Joined: Wed Oct 17, 2018 12:35 pm

errors post processing ComicRN

Post by fruitfrog »

Hi
Firstly, I love the application. What you do and how much time and support you put into this, I just need to say thank you.
I do owe you a cup of coffee or three.
I recently moved my installation to run in containers, but I cant seem to get the post processing working.
If anyone can help or offer advice, That would be welcome.
Versions:
ComicRN.py version: 1.01
autoProcessComics.py version: 2.04
nzbget : docker linuxserver/nzbget:latest
MyLar : docker linuxserver/mylar:latest

INFO Tue Oct 16 2018 21:55:22 ComicRN: requests to bypass this in the future (ie. pip install requests)
INFO Tue Oct 16 2018 21:55:22 ComicRN: Requests module not found on system. I'll revert so this will work, but you probably should install
INFO Tue Oct 16 2018 21:55:22 Executing post-process-script ComicRN.py for X.X.006.2018.Digital.Zone-Empire
INFO Tue Oct 16 2018 21:55:22 Nothing to cleanup for X.X.006.2018.Digital.Zone-Empire
INFO Tue Oct 16 2018 21:55:22 Cleaning up X.X.006.2018.Digital.Zone-Empire
INFO Tue Oct 16 2018 21:55:21 Nothing to unpack for X.X.006.2018.Digital.Zone-Empire
INFO Tue Oct 16 2018 21:55:21 No renamed archive files found for X.X.006.2018.Digital.Zone-Empire
INFO Tue Oct 16 2018 21:55:21 Checking renamed archive files for X.X.006.2018.Digital.Zone-Empire
INFO Tue Oct 16 2018 21:55:21 No renamed files found for X.X.006.2018.Digital.Zone-Empire
INFO Tue Oct 16 2018 21:55:21 Checking renamed files for X.X.006.2018.Digital.Zone-Empire
INFO Tue Oct 16 2018 21:55:21 Queueing X.X.006.2018.Digital.Zone-Empire for post-processing

If i check for requests module in the mylar container, its actually there
root@mylar:/$ pip install requests
Requirement already satisfied: requests in /usr/lib/python2.7/site-packages (2.19.1)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/lib/python2.7/site-packages (from requests) (3.0.4)
Requirement already satisfied: urllib3<1.24,>=1.21.1 in /usr/lib/python2.7/site-packages (from requests) (1.23)
Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python2.7/site-packages (from requests) (2018.8.24)
Requirement already satisfied: idna<2.8,>=2.5 in /usr/lib/python2.7/site-packages (from requests) (2.7)


16-Oct-2018 21:55:22 - DEBUG :: mylar.checkParams.80 : CP Server Thread-10 : Matched to key. Api set to : normal mode.
16-Oct-2018 21:55:22 - DEBUG :: mylar.fetchData.110 : CP Server Thread-10 : Received API command: forceProcess
16-Oct-2018 21:55:22 - INFO :: mylar._forceProcess.373 : CP Server Thread-10 : [API] Api Call from ComicRN detected - initiating script post-processing.
16-Oct-2018 21:55:22 - INFO :: mylar.post_process.788 : CP Server Thread-10 : ComicRN.py version: 1.01 -- autoProcessComics.py version: 2.04
16-Oct-2018 21:55:22 - INFO :: mylar.post_process.791 : CP Server Thread-10 : Starting postprocessing for : X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.344 : Post-Processing : [POST-PROCESSING] nzb name: X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.345 : Post-Processing : [POST-PROCESSING] nzb folder: /downloads/completed/comics/X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.347 : Post-Processing : [POST-PROCESSING] Not using SABnzbd
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.358 : Post-Processing : [POST-PROCESSING] Using NZBGET
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.359 : Post-Processing : [POST-PROCESSING] NZB name as passed from NZBGet: X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.364 : Post-Processing : [POST-PROCESSING] NZB name as passed from NZBGet: X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.366 : Post-Processing : [POST-PROCESSING] NZBGET Download folder option enabled. Directory set to : /downloads/completed/comics/X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.1120 : Post-Processing : [NZBNAME]: X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.1125 : Post-Processing : [NZBNAME] nzbname (remove chars): X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.1130 : Post-Processing : [NZBNAME] nzbname (remove extensions, double spaces, convert underscores to spaces): X X 006 2018 Digital Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.1133 : Post-Processing : [POST-PROCESSING] After conversions, nzbname is : X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - DEBUG :: mylar.Process.1162 : Post-Processing : [POST-PROCESSING] Issueid: 687010
16-Oct-2018 21:55:22 - INFO :: mylar.Process.1253 : Post-Processing : [PPINFO-POST-PROCESSING-ATTEMPT] {'publisher': None, 'comicname': u'X X', 'issueid': u'687010', 'comiclocation': None, 'sarc': None, 'issuenumber': u'6', 'oneoff': None, 'comicid': u'111415'}
16-Oct-2018 21:55:22 - INFO :: mylar.nzb_or_oneoff_pp.1379 : Post-Processing : [POST-PROCESSING] issuenzb found.
16-Oct-2018 21:55:22 - INFO :: mylar.duplicate_filecheck.2089 : Post-Processing : [DUPECHECK] Duplicate check for /downloads/completed/comics/X.X.006.2018.Digital.Zone-Empire
16-Oct-2018 21:55:22 - WARNING :: mylar.duplicate_filecheck.2093 : Post-Processing : [DUPECHECK] File cannot be located in location specified. Something has moved or altered the name.
16-Oct-2018 21:55:22 - WARNING :: mylar.duplicate_filecheck.2094 : Post-Processing : [DUPECHECK] Make sure if you are using ComicRN, you do not have Completed Download Handling enabled (or vice-versa). Aborting
16-Oct-2018 21:55:22 - ERROR :: mylar.excepthook.314 : Post-Processing : Uncaught exception: Traceback (most recent call last):
File "/app/mylar/mylar/logger.py", line 336, in new_run
old_run(*args, **kwargs)
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "/app/mylar/mylar/PostProcessor.py", line 1254, in Process
self.nzb_or_oneoff_pp(tinfo=pp)
File "/app/mylar/mylar/PostProcessor.py", line 1670, in nzb_or_oneoff_pp
if dupthis['action'] == 'dupe_src' or dupthis['action'] == 'dupe_file':
TypeError: 'NoneType' object has no attribute '__getitem__'


yet the file is actually there:

fruitfrog@ubu-container:/mnt/nzbget/downloads/completed/comics/X.X.006.2018.Digital.Zone-Empire$ ls -l
total 31204
-rw-r--r-- 1 mark mark 31950244 Oct 16 21:54 'X X 006 (2018) (Digital) (Zone-Empire).cbr'

The mount point for both containers "/downloads" mounts on the host "/mnt/nzbget/downloads"

Again, any help will be welcome.
I dont have complete handling enabled.
Thank you
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: errors post processing ComicRN

Post by evilhero »

Well firstly, thanks for the kind words :) It's always nice to hear feedback that's on the positive side!

Now on to your problem(s):

The requests error is due to not having the python requests library in the docker that contains nzbget. This is because the ComicRN.py script runs from the nzbget container after the item is snatched (it invokes mylar when it's run, but the initial run command is issued by nzbget itself). If you install the requests library in the given docker, that error will disappear - albeit it looks like it's attempting to post-process stuff fine without it, so you might not even need to worry about it unless you want to.

I'm not a docker person, but from what I can remember of some other's setup - I believe you have to specify the full mount point to the downloads directory under the NzbGet Download Directory option within Mylar. You have it set to /downloads/completed/comics I'd wager, but have you tried /mnt/nzbget/downloads/completed/comics ?

It's either that - and/or the user running Mylar doesn't have the proper permissions in order to read / access the file located in the nzbget downloads directory since you have it set to 0644 which might not be high enough permissions to execute a simple filesize command (since it would definitely need to open the file, although I think it might also require execute which would mean it would need to be 0744 if owner was running, or 0774 for group).

I'm assuming you're running the master branch of Mylar since most dockers are locked onto that branch - master got an update a few days ago, so you might want to update to the latest (just an FYI more than anything as nothing specific went in that would affect your current problem)
fruitfrog
Posts: 2
Joined: Wed Oct 17, 2018 12:35 pm

Re: errors post processing ComicRN

Post by fruitfrog »

Thank you !!

requests module was missing on the docker NZBget container.

docker exec -it nzbget bash
apk add py-requests

installed the missing files and everything is working !!
Post Reply