Issues finding series with colons in the title

Post any problems / bugs / issues that are Mylar-related in here.
Post Reply
escrima
Posts: 12
Joined: Sun Feb 12, 2017 7:18 pm

Issues finding series with colons in the title

Post by escrima » Thu Sep 07, 2017 1:31 am

Is there a problem with torrent search finding series with a colon in the title? When I search for Star Wars: Mace Windu for example on 32p, it never finds it. (or any other Star Wars series with : in it)

User avatar
evilhero
Site Admin
Posts: 2004
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Issues finding series with colons in the title

Post by evilhero » Thu Sep 07, 2017 12:44 pm

It's more a problem with the number of results that are returned. Currently, if it's searching for a series with a colon in it, it only uses the search term up to the colon (ie just Star Wars) due to how many differing naming conventions 32p & CV use. It will usually only take the first match result which causes theses problems with matching. One way around this atm, is to make use of the alternate search name field and put the full series title, but without a colon.

In the next dev commit (I know I say that alot, but I've been sitting on a big commit for a few weeks now just trying to work out all the kinks), there is a 'deep_search' option for 32p. In this case, when it encounters a colon-type series (as an example) it will cycle thru all the search results until it finds a correct match based on full series title, issue number and posting date - as opposed to just taking the first match. It then stores the given series ID on 32p so future searches for the same series will be much quicker as it will match against that particular series ID only (it rechecks every day or so to ensure that merges/moves on 32p have been accounted for and the ID is still the correct one).

escrima
Posts: 12
Joined: Sun Feb 12, 2017 7:18 pm

Re: Issues finding series with colons in the title

Post by escrima » Thu Oct 26, 2017 1:54 am

Any update on this? Unfortunately, there seems to me more and more titles like this lately.

User avatar
evilhero
Site Admin
Posts: 2004
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Issues finding series with colons in the title

Post by evilhero » Thu Oct 26, 2017 1:48 pm

Make sure you're up-to-date on whatever branch you're running - the deep_search_32p option is available in the config.ini in the latest commit of either branch. Shutdown Mylar, edit the config.ini and enable it (deep_search_32p = 1), save the config.ini and then start up Mylar. It should then be able to parse the titles properly when searching.

If you have issues that aren't being found, please paste in what they are that you're trying to search for and/or the results of said search so that I can try to troubleshoot more. Aside from trying to snatch GN's/TPB's and the odd annual, there hasn't been any known issues thus far with the searching on 32p that I've been made aware of.

escrima
Posts: 12
Joined: Sun Feb 12, 2017 7:18 pm

Re: Issues finding series with colons in the title

Post by escrima » Fri Oct 27, 2017 6:00 pm

Mylar Version: master
-- source build a226658876af19d60d3c4291ea158644731f143b.

Made change to config.ini

Still failing on the following:


Star Wars: Mace Windu
Star Wars: Poe Dameron
Batman: The Drowned
Kingsman: The Red Diamond
Star Wars: Rogue One - Cassian & K2SO Special
Punisher: The Platoon
Could not find Issue 3 of Star Wars: Mace Windu (2017) using 32P [api]
2017-10-27 14:02:39 INFO payload: {'action': 'groupsearch', 'issue': u'3', 'id': u'21312'}
2017-10-27 14:02:39 DEBUG Unable to properly verify reference on 32P - will update the 32P reference point once the issue has been successfully matched against.
2017-10-27 14:02:39 INFO 1 series match the tile being searched for on 32P...
2017-10-27 14:02:39 INFO dataset: [{'series': u'Star Wars: Mace Windu', 'id': u'21312'}]
2017-10-27 14:02:39 INFO 1 series listed for searching that match.
2017-10-27 14:02:39 INFO [MATCH] Star Wars: Mace Windu [21312]
2017-10-27 14:02:39 INFO searchresult: StarWarsMaceWindu --- StarWarsMaceWindu[Marvel]
2017-10-27 14:02:38 INFO series_search: Star Wars Mace Windu
2017-10-27 14:02:38 INFO publisher search set to : Marvel
2017-10-27 14:02:38 DEBUG [32P-AUTHENTICATION][LOGIN SUCCESS] Now preparing for the use of 32P keyed authentication...
2017-10-27 14:02:38 DEBUG [32P-AUTHENTICATION] Session key-based login was good.
2017-10-27 14:02:38 INFO inkdrops: {u'status': u'success', u'results': [{u'inkdrops': u'604142.3083', u'userid': 3805}]}
2017-10-27 14:02:37 DEBUG [32P-AUTHENTICATION] Session cookie found. Attempting to load...
2017-10-27 14:02:37 DEBUG calpha/cnumber: None / None
2017-10-27 14:02:37 INFO Shhh be very quiet...I'm looking for Star Wars Mace Windu issue: 3 (2017) using 32P
2017-10-27 14:02:37 INFO Alternate Search pattern detected...re-adjusting to : Star Wars Mace Windu
2017-10-27 14:02:35 INFO payload: {'action': 'groupsearch', 'issue': u'3', 'id': u'21312'}
2017-10-27 14:02:35 DEBUG Unable to properly verify reference on 32P - will update the 32P reference point once the issue has been successfully matched against.
2017-10-27 14:02:35 INFO 1 series match the tile being searched for on 32P...
2017-10-27 14:02:35 INFO dataset: [{'series': u'Star Wars: Mace Windu', 'id': u'21312'}]
2017-10-27 14:02:35 INFO 1 series listed for searching that match.
2017-10-27 14:02:35 INFO [MATCH] Star Wars: Mace Windu [21312]
2017-10-27 14:02:35 INFO searchresult: StarWarsMaceWindu --- StarWarsMaceWindu[Marvel]
2017-10-27 14:02:35 INFO series_search: Star Wars: Mace Windu
2017-10-27 14:02:35 INFO publisher search set to : Marvel
2017-10-27 14:02:35 DEBUG [32P-AUTHENTICATION][LOGIN SUCCESS] Now preparing for the use of 32P keyed authentication...
2017-10-27 14:02:35 DEBUG [32P-AUTHENTICATION] Session key-based login was good.
2017-10-27 14:02:35 INFO inkdrops: {u'status': u'success', u'results': [{u'inkdrops': u'604142.3083', u'userid': 3805}]}
2017-10-27 14:02:33 DEBUG [32P-AUTHENTICATION] Session cookie found. Attempting to load...
2017-10-27 14:02:33 DEBUG calpha/cnumber: None / None
2017-10-27 14:02:33 INFO Shhh be very quiet...I'm looking for Star Wars: Mace Windu issue: 3 (2017) using 32P

User avatar
evilhero
Site Admin
Posts: 2004
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Issues finding series with colons in the title

Post by evilhero » Fri Oct 27, 2017 6:31 pm

Star Wars:Mace Windu #3 isn't on 32. Punisher: The Platoon has been changed to Punisher MAX: The Platoon so you'll have to either delete the series and re-add it under the new name or set the Alternate Search Name to Punisher MAX: The Platoon.

I was able to pull down Rogue One just fine from 32P, but it wouldn't post-process as it didn't have an issue numbe present in the filename (just add a '01' for an issue number and it worked fine thereafter). Batman the drowned works, as does Kingsman (pulled it fine).

There was a problem with the pull-list up until a few hrs ago that might have affected some items, and I believe it started last night. However if it says something like in your logs:
2017-10-27 14:02:35 INFO payload: {'action': 'groupsearch', 'issue': u'3', 'id': u'21312'}
2017-10-27 14:02:35 DEBUG Unable to properly verify reference on 32P - will update the 32P reference point once the issue has been successfully matched against.
2017-10-27 14:02:35 INFO 1 series match the tile being searched for on 32P...
2017-10-27 14:02:35 INFO dataset: [{'series': u'Star Wars: Mace Windu', 'id': u'21312'}]
it's actually finding it on 32P - that's what the dataset result shows - the series title and the torrentid for the series. It then says it cannot verify the torrentid as it's never been snatched previously, and will update the internal references once it's successfully downloaded it, so future searches save some queries. The payload lines indicates that it's searching for the issue against the torrent series id on 32p - and no results are returned as there are no further lines (meaning it doesn't exist on the site).

escrima
Posts: 12
Joined: Sun Feb 12, 2017 7:18 pm

Re: Issues finding series with colons in the title

Post by escrima » Sat Oct 28, 2017 8:50 pm

I deleted and re added poe dameron, batman the drowned, kingsman, Punisher. All failed except for Punisher. not sure what I'm doing wrong.
2017-10-28 16:54:37 DEBUG Could not find issue doing a manual search via : api
2017-10-28 16:54:37 INFO Could not find Issue 1 of Star Wars: Rogue One - Cassian & K2SO Special (2017) using 32P [api]
2017-10-28 16:54:36 INFO payload: {'action': 'groupsearch', 'issue': u'1', 'id': u'21167'}
2017-10-28 16:54:36 DEBUG Unable to properly verify reference on 32P - will update the 32P reference point once the issue has been successfully matched against.
2017-10-28 16:54:36 INFO 1 series match the tile being searched for on 32P...
2017-10-28 16:54:36 INFO dataset: [{'series': u'Star Wars: Rogue One - Cassian & K2SO Special', 'id': u'21167'}]
2017-10-28 16:54:36 INFO 1 series listed for searching that match.
2017-10-28 16:54:36 INFO [MATCH] Star Wars: Rogue One - Cassian & K2SO Special [21167]
2017-10-28 16:54:36 INFO searchresult: StarWarsRogueOneCassianK2SOSpecial --- StarWarsRogueOneCassianK2SOSpecial[Marvel]
2017-10-28 16:54:35 INFO series_search: Star Wars Rogue One - Cassian & K2SO Special
2017-10-28 16:54:35 INFO publisher search set to : Marvel
2017-10-28 16:54:35 DEBUG [32P-AUTHENTICATION][LOGIN SUCCESS] Now preparing for the use of 32P keyed authentication...
2017-10-28 16:54:35 DEBUG [32P-AUTHENTICATION] Session key-based login was good.
2017-10-28 16:54:35 INFO inkdrops: {u'status': u'success', u'results': [{u'inkdrops': u'604279.2747', u'userid': 3805}]}
2017-10-28 16:54:34 DEBUG [32P-AUTHENTICATION] Session cookie found. Attempting to load...
2017-10-28 16:54:34 DEBUG calpha/cnumber: None / None
2017-10-28 16:54:34 INFO Shhh be very quiet...I'm looking for Star Wars Rogue One - Cassian & K2SO Special issue: 1 (2017) using 32P
2017-10-28 16:54:34 INFO Alternate Search pattern detected...re-adjusting to : Star Wars Rogue One - Cassian & K2SO Special
2017-10-28 16:54:33 INFO payload: {'action': 'groupsearch', 'issue': u'1', 'id': u'21167'}
2017-10-28 16:54:33 DEBUG Unable to properly verify reference on 32P - will update the 32P reference point once the issue has been successfully matched against.
2017-10-28 16:54:33 INFO 1 series match the tile being searched for on 32P...
2017-10-28 16:54:33 INFO dataset: [{'series': u'Star Wars: Rogue One - Cassian & K2SO Special', 'id': u'21167'}]
2017-10-28 16:54:33 INFO 1 series listed for searching that match.
2017-10-28 16:54:33 INFO [MATCH] Star Wars: Rogue One - Cassian & K2SO Special [21167]
2017-10-28 16:54:33 INFO searchresult: StarWarsRogueOneCassianK2SOSpecial --- StarWarsRogueOneCassianK2SOSpecial[Marvel]
2017-10-28 16:54:32 INFO series_search: Star Wars: Rogue One - Cassian & K2SO Special
2017-10-28 16:54:32 INFO publisher search set to : Marvel
2017-10-28 16:54:32 DEBUG [32P-AUTHENTICATION][LOGIN SUCCESS] Now preparing for the use of 32P keyed authentication...
2017-10-28 16:54:32 DEBUG [32P-AUTHENTICATION] Session key-based login was good.
2017-10-28 16:54:32 INFO inkdrops: {u'status': u'success', u'results': [{u'inkdrops': u'604279.2747', u'userid': 3805}]}
2017-10-28 16:54:31 DEBUG [32P-AUTHENTICATION] Session cookie found. Attempting to load...
2017-10-28 16:54:31 DEBUG calpha/cnumber: None / None
2017-10-28 16:54:31 INFO Shhh be very quiet...I'm looking for Star Wars: Rogue One - Cassian & K2SO Special issue: 1 (2017) using 32P
2017-10-28 16:54:31 DEBUG Initiating Search via : api
2017-10-28 16:54:31 INFO search provider order is ['32p']
2017-10-28 16:54:31 DEBUG provider order sequence is now to start with 32p at spot #0
2017-10-28 16:54:31 DEBUG torrent provider found: 32p
2017-10-28 16:54:31 DEBUG checking against torrent provider: 32p
2017-10-28 16:54:31 DEBUG found provider in existing enabled providers.
2017-10-28 16:54:31 DEBUG Usenet Retention : 1500 days
2017-10-28 16:54:31 DEBUG there are : 0 nzb providers you have selected.
2017-10-28 16:54:31 DEBUG there are : 1 torrent providers you have selected.
2017-10-28 16:54:31 DEBUG nzbprovider(s): []
2017-10-28 16:54:31 DEBUG Checking for torrent enabled.
2017-10-28 16:54:31 INFO Issue Title given as : None
2017-10-28 16:54:31 DEBUG Publisher is : Marvel
2017-10-28 16:54:31 INFO [SEARCH] Special Characters exist within Series Title. Enabling search-safe Name : Star Wars Rogue One - Cassian & K2SO Special
2017-10-28 16:54:31 INFO Initiating manual search for Star Wars: Rogue One - Cassian & K2SO Special issue: 1

User avatar
evilhero
Site Admin
Posts: 2004
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Issues finding series with colons in the title

Post by evilhero » Tue Oct 31, 2017 5:06 pm

It looks like they removed the issue number from 32p - so it's just designated as a special, which their api can't return mainly because mylar itself doesn't handle filenames that don't contain an issue number of some sort. Think when I test snatched it, it pulled it from the RSS cache which had the issue number in it, although I can't verify it atm.

Post Reply