RSSCHECK stuck in infinite loop?

Post any problems / bugs / issues that are Mylar-related in here.
Post Reply
Aimhere
Posts: 98
Joined: Mon Apr 06, 2015 2:32 pm

RSSCHECK stuck in infinite loop?

Post by Aimhere »

Mylar master, build 562a8a851204051c1a60a63d80f6b1beb1b499fa, on Synology DiskStation 413j, DSM 4.3.

For the longest time now, I've had this problem where Mylar's python process causes nearly 100% CPU utilization on my DiskStation, leaving it less responsive for other tasks (network file transfers become really slow, etc.). Sometimes it seemed it only really did this at startup, and would eventually settle down. Looking at the debug logs, it appeared to just be doing its startup RSS Check at the time. I chalked it all up to my Synology just not having a powerful enough CPU, issued a "renice 19 -u mylar" command at a shell prompt to lower the task priority (so other tasks would speed up), and let it go at that. Even when Mylar was tying up the CPU, I could still work in the UI, add comics, perform searches, etc. (albeit slowly).

But more often than not, Mylar NEVER "settles down", and continues using all the CPU indefinitely. Or, it'll start using 100% CPU again at some point hours AFTER it initially "settles down". When this happens, if I look at the debug log, I see the following:

Code: Select all

26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : checking search result: WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : sub:WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : size given as: 20.6 MB
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 21552205
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Thu, 17 Sep 2015 23:41:26 +0200 is after store date of 2011-04-13
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Entry: WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Removed extension from filename: .cbr
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Cleantitle: whiz comics 025 (1941-12) (captain marvel story only) (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Cleantitle: whiz comics 025 (1941-12) (captain marvel story only) (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Comic: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 1. Bracket Word: 1941-12
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 3. Bracket Word: captain marvel story only
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Publisher detected within title : captain marvel story only
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : cnt is : 3 --- Publisher is: Marvel
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : removing publisher from title
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : pubremoved : whiz comics 025 (1941-12) () (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : blank brackets removed: whiz comics 025 (1941-12) (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Comic: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 1. Bracket Word: 1941-12
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 3. Bracket Word: 1st captain nazi and captain marvel, jr 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Publisher detected within title : 1st captain nazi and captain marvel, jr 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : cnt is : 3 --- Publisher is: Marvel
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : removing publisher from title
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : pubremoved : whiz comics 025 (1941-12) (captain marvel story only) ()
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : blank brackets removed: whiz comics 025 (1941-12) (captain marvel story only) 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Comic: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 1. Bracket Word: 1941-12
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 3. Bracket Word: captain marvel story only
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Publisher detected within title : captain marvel story only
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : cnt is : 3 --- Publisher is: Marvel
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : removing publisher from title
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : pubremoved : whiz comics 025 (1941-12) () (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : blank brackets removed: whiz comics 025 (1941-12) (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Comic: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : 1. Bracket Word: 1941-12
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : 3. Bracket Word: 1st captain nazi and captain marvel, jr 
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : Publisher detected within title : 1st captain nazi and captain marvel, jr 
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : cnt is : 3 --- Publisher is: Marvel
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : removing publisher from title
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : pubremoved : whiz comics 025 (1941-12) (captain marvel story only) ()
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : blank brackets removed: whiz comics 025 (1941-12) (captain marvel story only) 
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : 0. Bracket Word: whiz comics 025 
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : Comic: whiz comics 025 
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:48:46 - DEBUG   :: RSSCHECK : ComVersChk : 0
Everything after the 9th line (the "Cleantitle" line) just starts repeating over and over, tens of thousands of times, completely filling my log files. It appears to never finish processing the given title "WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr", and just gets stuck in an infinite loop!

Mind you, it took me the longest time to find the point at which it actually started looping. I had to shut down and restart Mylar several times, toggle on debug logging immediately, and repeatedly "tail -100 mylar.log", watching closely until I saw the whole "Whiz Comics/Captain Marvel" mess start to appear... then copy the entire batch of mylar.log files to a temporary folder so I could scroll through them and find the offending lines before Mylar could overwrite them. Note that everything up to the first line shown in the log above looks normal, e.g. Mylar processes any number of comic titles, logging only about 25 lines of text for each. But when it gets to the "Whiz Comics" item, it starts looping the same text over and over.

What's going on here? Why does this particular title keep causing the RSS Check to loop? Is it all the parenthesized sub-strings? By the way, in all this mess I don't see where it says WHICH RSS provider it's finding this comic on, or what it was searching for in the first place. I certainly don't have a "Whiz Comics" in my library.

I hate to disable RSS entirely, for fear that I might miss out on grabbing new releases quickly. But I might have to if this keeps up!

Aimhere
Aimhere
Posts: 98
Joined: Mon Apr 06, 2015 2:32 pm

Re: RSSCHECK stuck in infinite loop?

Post by Aimhere »

Update: I think I've at least found what Mylar was searching for when the looping started. There is a Marvel series called "S.H.I.E.L.D." where the final issue in the series has the issue number as "∞"... that's right, the literal symbol for "infinity". It is of course published as "S.H.I.E.L.D. Infinity (2011)", which may be confusing Mylar and/or the RSS feed providers.

I looked earlier in the debug logs and found the following:

Code: Select all

26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : Initiating Search via : rss
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : using Newznab host of : NZBGeek
26-Jun-2016 17:46:44 - INFO    :: RSSCHECK : Shhh be very quiet...I'm looking for S.H.I.E.L.D. issue: ∞ (2011) using NZBGeek(newznab) [RSS]
26-Jun-2016 17:46:44 - INFO    :: RSSCHECK : Unicode Issue present - adjusting.
26-Jun-2016 17:46:44 - INFO    :: RSSCHECK : int_issnum: 9999999999000
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : calpha/cnumber: None / 
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : RSS Check: yes
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : nzbprov: newznab
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : comicid: 32430
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : Sending request to RSS for S.H.I.E.L.D. : infinity (2011)
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : checking search result: For mejustme - all I could find Dynamite 012 (1975) (Superheroes Confidential - Iron Man) (Vigilante407-DCP)
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : sub:For mejustme - all I could find Dynamite 012 (1975) (Superheroes Confidential - Iron Man) (Vigilante407-DCP)
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : size given as: 1.7 MB
26-Jun-2016 17:46:44 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 1755000
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Failure to meet the Minimum size threshold - skipping
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : checking search result: For mejustme - all I could find Dynamite 001 (1974) (Superheroes Confidential - Superman) (Vigilante407-DCP)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : sub:For mejustme - all I could find Dynamite 001 (1974) (Superheroes Confidential - Superman) (Vigilante407-DCP)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : size given as: 1.6 MB
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 1707000
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Failure to meet the Minimum size threshold - skipping
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : checking search result: Strange Tales 019 (1988) (Servants of the Secret Fire! Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : sub:Strange Tales 019 (1988) (Servants of the Secret Fire! Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : size given as: 24.8 MB
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 26046000
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Sun, 26 Jun 2016 13:02:35 +0000 is after store date of 2011-04-13
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Entry: Strange Tales 019 (1988) (Servants of the Secret Fire! Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Cleantitle: strange tales 019 (1988) (servants of the secret fire! only) (digital) (anherogold-empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Cleantitle: strange tales 019 (1988) (servants of the secret fire! only) (digital) (anherogold-empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: strange tales 019 
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Comic: strange tales 019 
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 1. Bracket Word: 1988
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : year detected: 1988
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : year looking for: 2011
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 2011 - not right - years do not match
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 3. Bracket Word: servants of the secret fire! only
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : mini-series detected : servants of the secret fire! only
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 5. Bracket Word: digital
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : digital edition detected
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 7. Bracket Word: anherogold-empire
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Scanner detected: anherogold-empire
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : checking search result: Strange Tales 018 (1988) (A Touch of Your Hand Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : sub:Strange Tales 018 (1988) (A Touch of Your Hand Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : size given as: 21.8 MB
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 22876000
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Sun, 26 Jun 2016 13:02:35 +0000 is after store date of 2011-04-13
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Entry: Strange Tales 018 (1988) (A Touch of Your Hand Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Cleantitle: strange tales 018 (1988) (a touch of your hand only) (digital) (anherogold-empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Cleantitle: strange tales 018 (1988) (a touch of your hand only) (digital) (anherogold-empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: strange tales 018 
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Comic: strange tales 018 
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 1. Bracket Word: 1988
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : year detected: 1988
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : year looking for: 2011
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 2011 - not right - years do not match
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 3. Bracket Word: a touch of your hand only
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : mini-series detected : a touch of your hand only
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 5. Bracket Word: digital
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : digital edition detected
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 7. Bracket Word: anherogold-empire
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Scanner detected: anherogold-empire
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : checking search result: Strange Tales 017 (1988) (This Old Man Came Rolling Home! Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : sub:Strange Tales 017 (1988) (This Old Man Came Rolling Home! Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : size given as: 20.5 MB
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 21505000
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Sun, 26 Jun 2016 13:02:35 +0000 is after store date of 2011-04-13
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Entry: Strange Tales 017 (1988) (This Old Man Came Rolling Home! Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Cleantitle: strange tales 017 (1988) (this old man came rolling home! only) (digital) (anherogold-empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Cleantitle: strange tales 017 (1988) (this old man came rolling home! only) (digital) (anherogold-empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: strange tales 017 
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Comic: strange tales 017 
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 1. Bracket Word: 1988
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : year detected: 1988
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : year looking for: 2011
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 2011 - not right - years do not match
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 3. Bracket Word: this old man came rolling home! only
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 5. Bracket Word: digital
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : digital edition detected
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 7. Bracket Word: anherogold-empire
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Scanner detected: anherogold-empire
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : checking search result: Strange Tales 015 (1988) (On Having No Head Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : sub:Strange Tales 015 (1988) (On Having No Head Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : size given as: 22.4 MB
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 23486000
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Sun, 26 Jun 2016 12:59:49 +0000 is after store date of 2011-04-13
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Entry: Strange Tales 015 (1988) (On Having No Head Only) (Digital) (AnHeroGold-Empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Cleantitle: strange tales 015 (1988) (on having no head only) (digital) (anherogold-empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Cleantitle: strange tales 015 (1988) (on having no head only) (digital) (anherogold-empire)
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: strange tales 015 
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : Comic: strange tales 015 
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:46:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
...
26-Jun-2016 17:46:55 - INFO    :: RSSCHECK : Could not find Issue ∞ of S.H.I.E.L.D.(2010) using NZBGeek [rss]
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : using Newznab host of : OZNZB.com
26-Jun-2016 17:46:55 - INFO    :: RSSCHECK : Shhh be very quiet...I'm looking for S.H.I.E.L.D. issue: ∞ (2011) using OZNZB.com(newznab) [RSS]
26-Jun-2016 17:46:55 - INFO    :: RSSCHECK : Unicode Issue present - adjusting.
26-Jun-2016 17:46:55 - INFO    :: RSSCHECK : int_issnum: 9999999999000
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : calpha/cnumber: None / 
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : RSS Check: yes
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : nzbprov: newznab
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : comicid: 32430
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : Sending request to RSS for S.H.I.E.L.D. : infinity (2011)
26-Jun-2016 17:46:55 - INFO    :: RSSCHECK : Alphanumerics detected within IssueNumber. Seperating from Issue # and re-trying.
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : RSS Check: yes
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : nzbprov: newznab
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : comicid: 32430
26-Jun-2016 17:46:55 - DEBUG   :: RSSCHECK : Sending request to RSS for S.H.I.E.L.D. : %20infinity (2011)
26-Jun-2016 17:46:56 - INFO    :: RSSCHECK : Could not find Issue ∞ of S.H.I.E.L.D.(2010) using OZNZB.com [rss]

26-Jun-2016 17:46:56 - INFO    :: RSSCHECK : Shhh be very quiet...I'm looking for S.H.I.E.L.D. issue: ∞ (2011) using experimental [RSS]
26-Jun-2016 17:46:56 - INFO    :: RSSCHECK : Unicode Issue present - adjusting.
26-Jun-2016 17:46:56 - INFO    :: RSSCHECK : int_issnum: 9999999999000
26-Jun-2016 17:46:56 - DEBUG   :: RSSCHECK : calpha/cnumber: None / 
26-Jun-2016 17:46:56 - DEBUG   :: RSSCHECK : RSS Check: yes
26-Jun-2016 17:46:56 - DEBUG   :: RSSCHECK : nzbprov: experimental
26-Jun-2016 17:46:56 - DEBUG   :: RSSCHECK : comicid: 32430
26-Jun-2016 17:46:56 - DEBUG   :: RSSCHECK : Sending request to RSS for S.H.I.E.L.D. : infinity (2011)
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : this starts with FOR : For brightlights890 - . This is not present in the series - ignoring.
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : this starts with FOR : For RustyAngel13 - . This is not present in the series - ignoring.
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : this starts with FOR : For GoatGirl [3 of 12] . This is not present in the series - ignoring.
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : this starts with FOR : For Spectre99 . This is not present in the series - ignoring.
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : this starts with FOR : For nightgaunt, another Hauteville House 01 - . This is not present in the series - ignoring.
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : checking search result: Bucky Barnes - The Winter Soldier 02 (2015) (Digital).cbr
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : sub:Bucky Barnes - The Winter Soldier 02 (2015) (Digital).cbr
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : size given as: 59.2 MB
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 62091551
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Sat, 02 May 2015 02:32:15 +0200 is after store date of 2011-04-13
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Entry: Bucky Barnes - The Winter Soldier 02 (2015) (Digital).cbr
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Removed extension from filename: .cbr
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Cleantitle: bucky barnes - the winter soldier 02 (2015) (digital)
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Cleantitle: bucky barnes - the winter soldier 02 (2015) (digital)
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 0. Bracket Word: bucky barnes - the winter soldier 02 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Comic: bucky barnes - the winter soldier 02 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 1. Bracket Word: 2015
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : year detected: 2015
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : year looking for: 2011
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 2011 - not right - years do not match
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 3. Bracket Word: digital
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : digital edition detected
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : checking search result: FCBD 2015 - 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : sub:FCBD 2015 - 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : size given as: 27.3 MB
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 28584126
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Sun, 03 May 2015 05:02:26 +0200 is after store date of 2011-04-13
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Entry: FCBD 2015 - 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Cleantitle: fcbd 2015 - 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : detected invalid nzb filename - attempting to detect year to continue
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Cleantitle: fcbd (2015)  - 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 0. Bracket Word: fcbd 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Comic: fcbd 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 1. Bracket Word: 2015
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : year detected: 2015
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : year looking for: 2011
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 2011 - not right - years do not match
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 2. Bracket Word:   - 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : checking search result: Tales Of Honor Bred To Kill 00 - Free Comic Book Day (2015) (Digital) (Dr. Greenthumb).cbr
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : sub:Tales Of Honor Bred To Kill 00 - Free Comic Book Day (2015) (Digital) (Dr. Greenthumb).cbr
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : size given as: 27.3 MB
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 28584126
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Sun, 03 May 2015 05:02:26 +0200 is after store date of 2011-04-13
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Entry: Tales Of Honor Bred To Kill 00 - Free Comic Book Day (2015) (Digital) (Dr. Greenthumb).cbr
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Removed extension from filename: .cbr
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Cleantitle: tales of honor bred to kill 00 - free comic book day (2015) (digital) (dr  greenthumb)
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Cleantitle: tales of honor bred to kill 00 - free comic book day (2015) (digital) (dr  greenthumb)
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 0. Bracket Word: tales of honor bred to kill 00 - free comic book day 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Comic: tales of honor bred to kill 00 - free comic book day 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : mini-series detected : tales of honor bred to kill 00 - free comic book day 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 1. Bracket Word: 2015
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : year detected: 2015
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : year looking for: 2011
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 2011 - not right - years do not match
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 3. Bracket Word: digital
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : digital edition detected
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 5. Bracket Word: dr  greenthumb
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : checking search result: Palmiotti and Brady's The Big Con Job 003 (2015) (Digital) (AnHeroGold-Empire).cbz
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : sub:Palmiotti and Brady's The Big Con Job 003 (2015) (Digital) (AnHeroGold-Empire).cbz
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : size given as: 45.2 MB
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 47443675
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Thu, 07 May 2015 04:36:22 +0200 is after store date of 2011-04-13
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Entry: Palmiotti and Brady's The Big Con Job 003 (2015) (Digital) (AnHeroGold-Empire).cbz
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Removed extension from filename: .cbz
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Cleantitle: palmiotti and brady's the big con job 003 (2015) (digital) (anherogold-empire)
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Cleantitle: palmiotti and brady's the big con job 003 (2015) (digital) (anherogold-empire)
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 0. Bracket Word: palmiotti and brady's the big con job 003 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Comic: palmiotti and brady's the big con job 003 
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 1. Bracket Word: 2015
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : year detected: 2015
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : year looking for: 2011
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 2011 - not right - years do not match
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 3. Bracket Word: digital
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : digital edition detected
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : 5. Bracket Word: anherogold-empire
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : Scanner detected: anherogold-empire
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : checking search result: Bucky Barnes - The Winter Soldier 008 (2015) (Digital) (Zone-Empire).cbr
26-Jun-2016 17:46:57 - DEBUG   :: RSSCHECK : sub:Bucky Barnes - The Winter Soldier 008 (2015) (Digital) (Zone-Empire).cbr
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : size given as: 54.2 MB
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 56870750
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : Thu, 14 May 2015 05:40:16 +0200 is after store date of 2011-04-13
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : Entry: Bucky Barnes - The Winter Soldier 008 (2015) (Digital) (Zone-Empire).cbr
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : Removed extension from filename: .cbr
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : Cleantitle: bucky barnes - the winter soldier 008 (2015) (digital) (zone-empire)
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : Cleantitle: bucky barnes - the winter soldier 008 (2015) (digital) (zone-empire)
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : 0. Bracket Word: bucky barnes - the winter soldier 008 
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : Comic: bucky barnes - the winter soldier 008 
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : 1. Bracket Word: 2015
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : year detected: 2015
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : year looking for: 2011
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : 2011 - not right - years do not match
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : 3. Bracket Word: digital
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : digital edition detected
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : 5. Bracket Word: zone-empire
26-Jun-2016 17:46:58 - DEBUG   :: RSSCHECK : Scanner detected: zone-empire
...
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : checking search result: WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : sub:WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : size given as: 20.6 MB
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 21552205
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Thu, 17 Sep 2015 23:41:26 +0200 is after store date of 2011-04-13
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Entry: WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Removed extension from filename: .cbr
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Cleantitle: whiz comics 025 (1941-12) (captain marvel story only) (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Cleantitle: whiz comics 025 (1941-12) (captain marvel story only) (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Comic: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 1. Bracket Word: 1941-12
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 3. Bracket Word: captain marvel story only
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Publisher detected within title : captain marvel story only
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : cnt is : 3 --- Publisher is: Marvel
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : removing publisher from title
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : pubremoved : whiz comics 025 (1941-12) () (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : blank brackets removed: whiz comics 025 (1941-12) (1st captain nazi and captain marvel, jr )
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Comic: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : ComVersChk : 0
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 1. Bracket Word: 1941-12
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 3. Bracket Word: 1st captain nazi and captain marvel, jr 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Publisher detected within title : 1st captain nazi and captain marvel, jr 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : cnt is : 3 --- Publisher is: Marvel
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : removing publisher from title
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : pubremoved : whiz comics 025 (1941-12) (captain marvel story only) ()
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : blank brackets removed: whiz comics 025 (1941-12) (captain marvel story only) 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : 0. Bracket Word: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : Comic: whiz comics 025 
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : UseFuzzy is  : None
26-Jun-2016 17:48:45 - DEBUG   :: RSSCHECK : ComVersChk : 0

So it seems that Mylar is interpreting the issue number as "9999999999000". Then it sends the request to NZBGeek RSS as "S.H.I.E.L.D. : infinity (2011)". NZBGeek returns a few hits, none of which are a match. Then Mylar moves on to OZNZB, where it finds no matches. Finally, it tries Experimental, which returns a TON of hits (most of which are completely unrelated), and Mylar starts processing them. Eventually, it gets to the "WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr" I mentioned in my first post, and THIS is the point at which Mylar starts an infinite loop.

So, it seems that (a) it all starts with the issue number being "infinity", which (b) causes Experimental to return too many unrelated hits, one of which (c) is "WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr", which (d) Mylar apparently cannot parse properly and goes into an infinite loop.

Infinity and computers don't mix. Who knew? :P

Seriously, though, the ultimate problem is Mylar's parsing of the filename. I think I'm going to just have to mark the issue as "skipped" for now, to keep Mylar from trying to search for it...
User avatar
evilhero
Site Admin
Posts: 2887
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: RSSCHECK stuck in infinite loop?

Post by evilhero »

Aimhere wrote:Update: I think I've at least found what Mylar was searching for when the looping started. There is a Marvel series called "S.H.I.E.L.D." where the final issue in the series has the issue number as "∞"... that's right, the literal symbol for "infinity". It is of course published as "S.H.I.E.L.D. Infinity (2011)", which may be confusing Mylar and/or the RSS feed providers.

So it seems that Mylar is interpreting the issue number as "9999999999000". Then it sends the request to NZBGeek RSS as "S.H.I.E.L.D. : infinity (2011)". NZBGeek returns a few hits, none of which are a match. Then Mylar moves on to OZNZB, where it finds no matches. Finally, it tries Experimental, which returns a TON of hits (most of which are completely unrelated), and Mylar starts processing them. Eventually, it gets to the "WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr" I mentioned in my first post, and THIS is the point at which Mylar starts an infinite loop.

So, it seems that (a) it all starts with the issue number being "infinity", which (b) causes Experimental to return too many unrelated hits, one of which (c) is "WHIZ Comics 025 (1941-12) (Captain Marvel story only) (1st Captain Nazi and Captain Marvel, Jr.).cbr", which (d) Mylar apparently cannot parse properly and goes into an infinite loop.

Infinity and computers don't mix. Who knew? :P

Seriously, though, the ultimate problem is Mylar's parsing of the filename. I think I'm going to just have to mark the issue as "skipped" for now, to keep Mylar from trying to search for it...
The int_issnumber is just for internal use of Mylar - it's not the actual search number that Mylar searches for, that's either the infinity symbol (which can't be searched for), or the word 'infinity'.

Again Experimental is just that, experimental. It uses a very basic regex parser that was provided by a helpful fellow years ago, and it hasn't been revisited since (since it mainly relies on parsing the rss since they don't have an api of any kind). It does a very basic matching and as a result it usually returns a crapload of hits that aren't even relevant to the issue at hand being searched for. Using newznab providers allows for more precise control over the resulting match set.

This (again like we talked about in other posts), is one of those exact reasons why the search module needs to get updated to follow the same module code as the filechecker/importer and post-processor within Mylar. The search uses a completely independent searching algorithim and matching formula, which is a complete mess of things. It works most of the time, but when something like the Whiz comics shows up, it fails for obvious reasons.

Disabling Experimental would fix this problem, since it's an Experimental problem alone but I do realize the benefit of using the Experimental search - just not in these cases where they cause problems that break things. I'll try and look into the regex's and see if I can come up with a better matching, but since I didn't write them, it might just be me taking shots in the dark unfortunately.
Aimhere
Posts: 98
Joined: Mon Apr 06, 2015 2:32 pm

Re: RSSCHECK stuck in infinite loop?

Post by Aimhere »

evilhero wrote:
Aimhere wrote: Disabling Experimental would fix this problem, since it's an Experimental problem alone but I do realize the benefit of using the Experimental search - just not in these cases where they cause problems that break things. I'll try and look into the regex's and see if I can come up with a better matching, but since I didn't write them, it might just be me taking shots in the dark unfortunately.
I guess I'll disable Experimental (again) and see if it helps. I did find another (better?) newznab search provider to use, hopefully I will still be able to find all the comics I want.

You know, you really ought to look into getting some help with the Mylar code. I often get the impression that you're the only one working on it. (This is open-source, isn't it?)

Aimhere
User avatar
evilhero
Site Admin
Posts: 2887
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: RSSCHECK stuck in infinite loop?

Post by evilhero »

Well if that's the impression you're given, then you're correct.

I'm the only one handling the code, issues, forums, troubleshooting and enhancements, etc.

There are other individuals that help out when they can (guys on irc are great at helping where they're able to), and there have been others that have provided some pull requests for mylar that save me a crap load of time - but I'm (for the most part) the only one doing the coding. Due to the coding ownership, I also have to wear the troubleshooting, bug fixing and general help with mylar since I have the most intimate knowledge of it.

Open source is great, but it doesn't necessarily mean that others help out by default. Because it's on git there's nothing stopping someone from seeing how things work or forking their own version (thus the git_user option within the config.ini).

Comics is by far more a niche hobby then say music, or movies or even tv. As such, the amount of individuals willing to help hasn't been a lot.

Those that can help usually find a way to help, whether it's on irc or in the forums, for which I'm extremely grateful as it saves me the time. Others may tend to take the atypical stance of individuals using a program such as mylar and just either a) praise it, b) condone it as p.o.s, c) just wait for updates, or d) all of the above.

Any of the options don't bother me as everyone's entitled to their own opinion about the program. It's a labour of love for myself - started this as a whim and to learn python, and it's grown into what it is today thanks in very large part to the mylar community providing feedback, logs, bug reports, enhancement requests and even pull requests.

Yes, I spend an inordinate amount of time with mylar, but I actually enjoy working on it as it gives me something to do that breaks the monoity of things, and I'm always learning.

That being said, aside from a secretary (wife says no way), I'm always open to the help ;)
Aimhere
Posts: 98
Joined: Mon Apr 06, 2015 2:32 pm

Re: RSSCHECK stuck in infinite loop?

Post by Aimhere »

Hey, I understand. Everyone here does appreciate your efforts.
Aimhere
Posts: 98
Joined: Mon Apr 06, 2015 2:32 pm

Re: RSSCHECK stuck in infinite loop?

Post by Aimhere »

After disabling Experimental search, I'm no longer seeing Mylar tying up my CPU indefinitely.
Post Reply