Comic name 03 (of 05) naming structure doesn't work with Mylar

Post any problems / bugs / issues that are Mylar-related in here.
Post Reply
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Comic name 03 (of 05) naming structure doesn't work with Mylar

Post by leaderdog »

Hi Evilhero,

I tried searching but the search words are to "common" so I apologize if this has been brought up.

Naming structures such as:

Warhammer 40,000 - Exterminatus 01 (of 05) (BOOM! Studios 2008) (Minutemen-Tha Choppaz).cbr

manual post-processing either ignores the file or sometimes puts it in comics dup folder.

I removed everything but the single offending file (already moved the others over manually) this is what code says:

Code: Select all

04-Mar-2018 11:52:21 - INFO    :: CP Server Thread-3 : Starting postprocessing for : Manual Run
04-Mar-2018 11:52:21 - INFO    :: Thread-57 : there are 1 files.
04-Mar-2018 11:52:21 - INFO    :: Thread-57 : I have located 1 files that I should be able to post-process. Continuing...
04-Mar-2018 11:52:21 - INFO    :: Thread-57 : [POST-PROCESSING] Alternate series naming detected: Warhammer 40 000
04-Mar-2018 11:52:22 - INFO    :: Thread-57 : [POST-PROCESSING] No matches for Manual Run ... exiting.
As a side note. Someone is posting their entire collection starting with the letter 'Z' in a.b.p.c.repost. Which is nice, though not noticing any of my indexers that monitor that binary. But what I see is he has the words:
(Games Worksop)
at the beginning of each file which interferes with manual post processing. I use flash renamer to remove the words since that immediately stops Mylar from doing its job.
This is what it shows with (Games Worksop):

Code: Select all

04-Mar-2018 12:02:40 - INFO    :: Thread-31 : [FOLDER-CHECK] Checking folder L:\Complete for newly snatched downloads
04-Mar-2018 12:02:40 - INFO    :: Thread-31 : there are 7 files.
04-Mar-2018 12:02:40 - INFO    :: Thread-31 : I have located 7 files that I should be able to post-process. Continuing...
04-Mar-2018 12:02:41 - INFO    :: Thread-31 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000
04-Mar-2018 12:02:41 - INFO    :: Thread-31 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000
04-Mar-2018 12:02:41 - INFO    :: Thread-31 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000
04-Mar-2018 12:02:41 - INFO    :: Thread-31 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000 - Damnation Crusade (of 6) (3 covers)
04-Mar-2018 12:02:41 - INFO    :: Thread-31 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000 - Damnation Crusade (of 6) (2 covers)
04-Mar-2018 12:02:41 - INFO    :: Thread-31 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000 - Damnation Crusade (of 6) (2 covers)
04-Mar-2018 12:02:41 - INFO    :: Thread-31 : [POST-PROCESSING] Alternate series naming detected: Warhammer 40 000
04-Mar-2018 12:02:41 - INFO    :: Thread-31 : [POST-PROCESSING] No matches for Manual Run ... exiting.
04-Mar-2018 12:02:41 - INFO    :: Thread-31 : [FOLDER-CHECK] Finished checking for newly snatched downloads
04-Mar-2018 12:02:46 - INFO    :: CP Server Thread-6 : Starting postprocessing for : Manual Run
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : there are 7 files.
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : I have located 7 files that I should be able to post-process. Continuing...
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000 - Damnation Crusade (of 6) (3 covers)
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000 - Damnation Crusade (of 6) (2 covers)
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : [POST-PROCESSING] Alternate series naming detected: (Games Worksop) Warhammer 40 000 - Damnation Crusade (of 6) (2 covers)
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : [POST-PROCESSING] Alternate series naming detected: Warhammer 40 000
04-Mar-2018 12:02:46 - INFO    :: Thread-60 : [POST-PROCESSING] No matches for Manual Run ... exiting.
That may be outside of the scope of Mylar as that's apparently how he's naming his files. Which if that's the case I'll just keep removing it with flash renamer, however the name 03 (of 05) would be nice if Mylar could process.

Thanks for any feed back. :)
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Comic name 03 (of 05) naming structure doesn't work with Mylar

Post by evilhero »

The problem with the naming convention of
Warhammer 40,000 - Exterminatus 01 (of 05) (BOOM! Studios 2008) (Minutemen-Tha Choppaz).cbr
is that the publisher is included with the year. Remove the 'Boom! Studios' and leave the 2008 within brackets, and it should be able to pp it just fine (you might want to make sure you're up-to-date on the development branch, there was a bug in the post-processing module where it was failing on story-arc lookups entirely and completely stalling the post-processing run).

As far as the newsgroups, you can try a manual fix via the code directly - and if it works, I can add in some exception configuration option in the config.ini to allow for manual inclusion going forward (if it works I mean).

Here's what you can do, with Mylar not running:
- backup the mylar/findcomicfeed.py file just in case (and to make sure you can update cause you'll have to put it back to do an update thereafter)
- edit the mylar/findcomicfeed.py file
-find line 60 which references 'feeds.append'
-add in the following line right btwn feeds.append & time.sleep(3)

Code: Select all

feeds.append(feedparser.parse("http://nzbindex.nl/rss/alt.binaries.pictures.comics.repost/?sort=agedesc&" + str(size_constraints) + str(max_age) + "&dq=%s&max=50&more=1" %joinSearch))
- find line 108 which references the 'except_list'
- add in the wording you want for it to remove from the header:

Code: Select all

except_list = ['releases', 'gold line', 'distribution', '0-day', '0 day', 'Games Worksop']
- save the file, start Mylar and see what happens
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Re: Comic name 03 (of 05) naming structure doesn't work with Mylar

Post by leaderdog »

Thanks Evilhero,

I'm giving it a try right now. I usually don't have experimental on, I just did a search on nzbindex for Gamesop and it popped up with all the warhammer comics, so that line may not be needed?

hmm, oddly enough. I can't even load Mylar after putting those settings into the file. Python.exe briefly shows in the windows task manager and then is gone.

Code: Select all

Microsoft Windows [Version 6.1.7601]
Copyright (c) 2009 Microsoft Corporation.  All rights reserved.

c:\Mylar>mylar.py
Traceback (most recent call last):
  File "C:\Mylar\Mylar.py", line 26, in <module>
    import mylar
  File "C:\Mylar\mylar\__init__.py", line 41, in <module>
    from mylar import logger, versioncheckit, rsscheckit, searchit, weeklypullit
, PostProcessor, updater, helpers
  File "C:\Mylar\mylar\weeklypullit.py", line 20, in <module>
    from mylar import logger, helpers, weeklypull
  File "C:\Mylar\mylar\weeklypull.py", line 32, in <module>
    from mylar import db, updater, helpers, logger, newpull, importer, mb, locg
  File "C:\Mylar\mylar\importer.py", line 36, in <module>
    from mylar import logger, helpers, db, mb, cv, parseit, filechecker, search,
 updater, moveit, comicbookdb
  File "C:\Mylar\mylar\search.py", line 19, in <module>
    from mylar import logger, db, updater, helpers, parseit, findcomicfeed, noti
fiers, rsscheck, Failed, filechecker, auth32p, sabnzbd, nzbget, wwt
  File "C:\Mylar\mylar\findcomicfeed.py", line 60
    time.sleep(3)
    ^
IndentationError: unexpected indent

c:\Mylar>
I put back the original file and only added games worksop on line 109

Code: Select all

c:\Mylar>mylar.py
Traceback (most recent call last):
  File "C:\Mylar\Mylar.py", line 26, in <module>
    import mylar
  File "C:\Mylar\mylar\__init__.py", line 41, in <module>
    from mylar import logger, versioncheckit, rsscheckit, searchit, weeklypullit
, PostProcessor, updater, helpers
  File "C:\Mylar\mylar\weeklypullit.py", line 20, in <module>
    from mylar import logger, helpers, weeklypull
  File "C:\Mylar\mylar\weeklypull.py", line 32, in <module>
    from mylar import db, updater, helpers, logger, newpull, importer, mb, locg
  File "C:\Mylar\mylar\importer.py", line 36, in <module>
    from mylar import logger, helpers, db, mb, cv, parseit, filechecker, search,
 updater, moveit, comicbookdb
  File "C:\Mylar\mylar\search.py", line 19, in <module>
    from mylar import logger, db, updater, helpers, parseit, findcomicfeed, noti
fiers, rsscheck, Failed, filechecker, auth32p, sabnzbd, nzbget, wwt
  File "C:\Mylar\mylar\findcomicfeed.py", line 108
    except_list=['releases', 'gold line', 'distribution', '0-day', '0 day', 'Gam
es Worksop']]

            ^
SyntaxError: invalid syntax

c:\Mylar>
it don't like it ;)

I'll try anyways with experimental on, well, minus the warhammer stuff just to see if it imports.
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Re: Comic name 03 (of 05) naming structure doesn't work with Mylar

Post by leaderdog »

I'm not having any luck with experimental at all. I turned off all my other indexers.

most of the files have (of 0#).

I've manually downloaded them from nzbindex and the files are fine. But for whatever reason I'm not getting any returns from there.

I made sure to try the ones without the (of 0#) and they don't work either. But if I manually downloaded them via nzbindex, Mylar moves it over when manually post-processing kicks in.

Code: Select all

04-Mar-2018 14:41:00 - INFO    :: Thread-29 : Initiating manual search for War of Kings issue: 5
04-Mar-2018 14:41:00 - INFO    :: Thread-29 : Issue Title given as : in rage and blood and fire
04-Mar-2018 14:41:00 - INFO    :: Thread-29 : search provider order is ['Experimental']
04-Mar-2018 14:41:00 - INFO    :: Thread-29 : Shhh be very quiet...I'm looking for War of Kings issue: 5 (2009) using experimental [RSS]
04-Mar-2018 14:41:00 - INFO    :: Thread-29 : Could not find Issue 5 of War of Kings (2009) using experimental [rss]
04-Mar-2018 14:41:00 - INFO    :: Thread-29 : Shhh be very quiet...I'm looking for War of Kings issue: 5 (2009) using experimental [RSS]
04-Mar-2018 14:41:00 - INFO    :: Thread-29 : Could not find Issue 5 of War of Kings (2009) using experimental [rss]
04-Mar-2018 14:41:00 - INFO    :: Thread-29 : Shhh be very quiet...I'm looking for War of Kings issue: 5 (2009) using experimental [RSS]
04-Mar-2018 14:41:00 - INFO    :: Thread-29 : Could not find Issue 5 of War of Kings (2009) using experimental [rss]
04-Mar-2018 14:41:00 - INFO    :: Thread-29 : Shhh be very quiet...I'm looking for War of Kings issue: 5 (2009) using experimental
04-Mar-2018 14:41:07 - INFO    :: Thread-29 : Could not find Issue 5 of War of Kings (2009) using experimental [api]
04-Mar-2018 14:41:37 - INFO    :: Thread-29 : Shhh be very quiet...I'm looking for War of Kings issue: 5 (2009) using experimental
04-Mar-2018 14:41:47 - INFO    :: Thread-29 : Could not find Issue 5 of War of Kings (2009) using experimental [api]
04-Mar-2018 14:42:17 - INFO    :: Thread-29 : Shhh be very quiet...I'm looking for War of Kings issue: 5 (2009) using experimental
04-Mar-2018 14:42:25 - INFO    :: Thread-29 : Could not find Issue 5 of War of Kings (2009) using experimental [api]
04-Mar-2018 14:42:25 - INFO    :: Thread-29 : findit: {'status': False}
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Comic name 03 (of 05) naming structure doesn't work with Mylar

Post by evilhero »

leaderdog wrote: Sun Mar 04, 2018 7:47 pm
time.sleep(3)
^
IndentationError: unexpected indent
your time.sleep line isn't properly indented. It has to be in line with the line previous to it - python cares deeply about how you space/tab things so much so that if they're not properly aligned, she go boom.

except_list=['releases', 'gold line', 'distribution', '0-day', '0 day', 'Gam
es Worksop']]

^
SyntaxError: invalid syntax
You have 2 square brackets at the end of the line, when there should be only one

Without adding that feed.append line with the new binary group, it won't tell nzbindex to search that group for any matches, so if you want to include that group because that's where the posts are - then the feed has to be added. Hopefully that'll help get you past that part if you're still trying to grab the issues at this point...
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Re: Comic name 03 (of 05) naming structure doesn't work with Mylar

Post by leaderdog »

/scratches his head.

I'm using notepad++ to add the line. It all looks lined up nicely, indented correctly and all that, but when I run the program it has indent issues.

All I'm doing is hitting enter after the last line before the time.sleep, then pasting in the line you gave me.

it doesn't like it. or Notepadd++ saves it funny?


Weird, ok this time I tried with just regular old notepad. When I pasted it, the line slid to a second line and I just hit tab to line it up. And it worked. How bizarre.

now to find something exclusive to his repost.

Thanks :)
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Re: Comic name 03 (of 05) naming structure doesn't work with Mylar

Post by leaderdog »

ok, it doesn't look like it's locating files from a.b.p.c.reposts.

but something else funny might have happened because the first ones I was looking for had no problem with experimental until it got to issue 09, then it wouldn't find issues 1- 9. had to grab them with newsleecher.

I'll have to play with it some more later, I've got to shovel snow before work. boooo

Thanks for your help!
Post Reply