wrong comicid for new "This Week"

Post any problems / bugs / issues that are Mylar-related in here.
Post Reply
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

wrong comicid for new "This Week"

Post by leaderdog »

Hi Evilhero,

Love the new weekly option! But noticed a problem:

IDW Publishing G.I. Joe: A Real American Hero 230 Skipped add series one off

doesn't recognize the correct one that I already have in mylar it redirects to the TPB one:

hxxp://comicvine.gamespot.com/gi-joe-a-real-american-hero/4050-53587/

It should go here:

hxxp://comicvine.gamespot.com/gi-joe-a-real-american-hero/4050-32910/

would it be possible to add in the "Edit Settings" a comicid display and then option to edit to add the correct one? Would that just mess up future updates? Or is this just a simple early bug that is corrected on your end?

Also notice that about 11 books that I do have already aren't being recognized, but it may just be a bit early. Will check that tomorrow to see if it updates. Or should I be doing a recreate pull-list?

Excited to see how this will work out!!

Thanks!
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: wrong comicid for new "This Week"

Post by evilhero »

The GI Joe should be fixed now - you just need to do a recreate pull-list to pull down the proper ID.

As far as the other 11 issues, alot of it is dependent on when CV pushed out the information. Typically by Late Monday evening / Tuesday afternoon you should see a good deal of the series being Marked as Wanted and subsequently removed from the Upcoming section. Normally once the ID's are matching properly, there's no need to force edit a specific series to point to the ID - but I'll definitely look into this option as some kind of failsafe in case some weird things start happening and I'll obviously find out more now that the option has gone live.

If you want to post the series that aren't being recognized I can double check the sql on the site to make sure it's assigning the correct ID's to the right series. In some of the cases (like GI Joe), it assigns the wrong ComicID to the series since there are more than one series that match the result. I'm going to be building in some kind of issue number verification so that it will assign the ComicID based on the last issue number that CV has (will see how easy that is to accomplish, right now it's just me spouting wind).
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Re: wrong comicid for new "This Week"

Post by leaderdog »

ok sounds good.

Just curious, the new number one issues, like you said they aren't on CV yet. Does Mylar auto update those later (your site pushes an update) or would I have to do a 'recreate pull-list' before release day to ensure I can add them?

The series that didn't update that are in Mylar and on my PC already:

Aether and Empire
Assassins Creed Templars
Grimm Fairy Tales Presents Robyn Hood: I Love NY
Morning Glories
Stumptown
The Shadow: The Death of Margo Lane

odd one I have a series from 2013 but CV doesn't have anything newer or different and it's saying it's issue 2 when the digital series had 8 issues (not able to find the issues anywhere tho so I guess no big deal haha):
Night Trap

It seems that a few of them got picked up after the re-create pull list.

Number 1's there are 21 (if you count the reprints 'true Believers') Skipped + Watch + one off. as asked above do we just wait for them to be entered? or hit watch now?

Added twice:
Rick & Morty Lil Poopy Superstar
Rick and Morty: Lil' Poopy Superstar


So far I'm really impressed. only 6 issues not accounted for which is much much better than what it was before! :)

Thanks again!
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Re: wrong comicid for new "This Week"

Post by leaderdog »

hmm, seems I broke it haha

my wanted list displayed the error mentioned on github issues. So I did a full recreate pull list. I can see the wanted list again, but when I click on this week I get "The page isn't redirecting properly"

I'll check later today see if it sorted itself out.

I restarted Mylar and then shutdown and loaded it again.


checked logs and getting this:

Code: Select all

12-Jul-2016 10:23:14 - INFO    :: WEEKLYCHECK : [WEEKLY] Checking Weekly Pull-list for new releases/updates
12-Jul-2016 10:23:14 - INFO    :: WEEKLYCHECK : Weekly pull list present - checking if it's up-to-date..
12-Jul-2016 10:23:14 - INFO    :: WEEKLYCHECK : [PULL-LIST] Populating & Loading pull-list data directly from alternate website
12-Jul-2016 10:23:14 - INFO    :: WEEKLYCHECK : pulldate is : 00000000
12-Jul-2016 10:23:15 - WARNING :: WEEKLYCHECK : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:23:15 - INFO    :: WEEKLYCHECK : [PULL-LIST] Unable to retrieve weekly pull-list. Dropping down to legacy method of PW-file
12-Jul-2016 10:23:16 - INFO    :: WEEKLYCHECK : No series have been marked as being on auto-watch.
12-Jul-2016 10:23:34 - INFO    :: RSSCHECK : RSS Feed Check was last run at : 2016-07-12 10:03:41
12-Jul-2016 10:24:05 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:05 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:05 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:07 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:07 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:07 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:08 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:08 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:08 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:10 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:10 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:10 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:11 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:11 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:11 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:13 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:13 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:13 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:15 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:15 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:15 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:16 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:16 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:16 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:18 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:18 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:18 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:19 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:19 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:19 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:21 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:21 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:21 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:22 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))
12-Jul-2016 10:24:22 - INFO    :: CP Server Thread-6 : {'prev_weeknumber': 27, 'weeknumber': 28, 'year': 2016, 'endweek': 'July 16, 2016', 'startweek': 'July 10, 2016', 'current_weeknumber': '28', 'next_weeknumber': 29, 'midweek': '2016-07-13'}
12-Jul-2016 10:24:22 - INFO    :: CP Server Thread-6 : trying to repopulate to different week
12-Jul-2016 10:24:24 - WARNING :: CP Server Thread-6 : ('Connection aborted.', error(10061, 'No connection could be made because the target machine actively refused it'))

Also noticed this before. I have hundreds if not thousands of these:

Code: Select all

12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : rss:yes
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : allow_packs:False
12-Jul-2016 05:22:18 - INFO    :: RSSCHECK : newznab
In case it's pertinent:
Mylar Version: development
-- git build ca8b7a80950703f3e325761283f4ab6dd7d8f034.
Python Version : 2.7.10
windows 7
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: wrong comicid for new "This Week"

Post by evilhero »

The site went off line on its own - don't think it was due to anything other than a reslice of the vps (I'm really thinking I need to change vps providers). It's back online now, so everything should be working with the pullist again.

I'll look into the spam of those 3 lines, unnecessary at this point since all that information is spammed either earlier /later in the process anyways.
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Re: wrong comicid for new "This Week"

Post by leaderdog »

Hi Evilhero,

Not sure if you saw my response 2 posts up. But how do we add New issue number ones? I just did a refresh and it didn't change the options for the Number 1 issues. Watch is as good as we get for them.

I can add it manually, then it changes the status to wanted.

Thanks,
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Re: wrong comicid for new "This Week"

Post by leaderdog »

OK added them all manually (search for comic then add) It added those ones to Wanted on the "This Week" page.

Now slight issues maybe.

1) 'Domino Lady Threesome' according to CV is 'Domino Lady's Threesome (2016)' and I can't find it on the league of comic geeks site (not there)
2) 'Kevin Smith Yoga Hosers Sundance Super Special' according to CV 'Yoga Hosers: A Sundance Super Special! (2016)' and again, not on the league of comic geeks site

These two are both marked as Wanted on their respective pages, but didn't change in the "This Week".

Lifespanners and The Mighty Yeti as of this writing isn't on CV yet but both on Geeks (so nothing to do there)

Hope this helps. :)
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: wrong comicid for new "This Week"

Post by evilhero »

Yeah I saw your earlier messages but couldn't get to a machine to respond. I fixed all the links for those ones on the site so they all should link and resolve properly to the correct series. The issue information itself tho is dependent on when CV adds the data to their dB.

The watch option (for upcoming #1s) should be fixed in the next development commit. Right now the only way to add those types is to do what you did, add series and wait to see if they've been added yet to CV.

I'm also pretty sure that the Kevin Smith comic is a special of some kind with no issue #, so it wouldn't get populated by Mylar (since it currently ignores all tpb and gn - types). Not sure about the domino series as I couldn't even find it on CV to reference back to see what the problem might be
leaderdog
Posts: 377
Joined: Sun Apr 26, 2015 1:52 pm

Re: wrong comicid for new "This Week"

Post by leaderdog »

Ok good to know.

I added the new ones manually and it all seems to be working quite smoothly.

This is the cv for domino one: hxxp://comicvine.gamespot.com/domino-ladys-threesome/4050-92180/

A couple more that were added to "this week" list that showed up now and aren't linking up with existing mylar series:

These ones aren't hotlinked and can only add series

Grimm Fairy Tales Presents Wonderland (hxxp://comicvine.gamespot.com/wonderland/4050-50639/)
The Shadow: The Death of Margo Lane (hxxp://comicvine.gamespot.com/the-shadow-the-death-of-margot-lane/4050-90888/)
Titan (hxxp://comicvine.gamespot.com/titan/4050-82537/)

These ones hotlink to the correct Mylar page but don't show as wanted (does than mean I should do a recreate pull-list?):
Morning Glories
Ragnarök
Stumptown (shows 2 of these on mine one for Oni Press another for IDW but both go to the same place in Mylar (hxxp://comicvine.gamespot.com/stumptown/4050-76894/)
Birthright

I did do a refresh on the above series and they all showed the new issue as wanted on their respective pages. Only stumptown had all 000's for a date

Then there is the goofy digital series/printed series:
This is the printed series of:
DC Comics Bombshells 15 - (hxxp://comicvine.gamespot.com/dc-comics-bombshells/4050-83810/) but it redirects to the digital series.
DC Comics Bombshells (hxxp://comicvine.gamespot.com/dc-comics-bombshells/4050-83493/)

I hope this is helpful, and as always great work! :)
User avatar
evilhero
Site Admin
Posts: 2883
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: wrong comicid for new "This Week"

Post by evilhero »

Yep, definitely helpful - as I can't watch every series, let alone know what's going on constantly with the series, so the more information I have about those that aren't working I can fix so that subsequent weeks it should match up properly.

I'm not sure on the Domino issue - it should be on the league site by now, so I'm kind of curious as to why it's not showing up there (and thereby within Mylar).

As far as the digital stuff, I've added a new column to the sql db on the new site to distinguish between digital / print (granted at this point it's a manual insertion by myself, but hoping to change that relatively soon), so that Mylar will be able to distinguish between digital/print versions within the weekly pull tab and indicate them as such. I'll try to add in an exception to the sql so that it will only grab the series that are 'non-digital'

For the issues that are hotlinked, you can do a Recreate pullist to try and let Mylar sort things out, it's got a mixed chance of working properly namely due to the alternate search names causing some problems with the sql atm (where CV has it listed as one way, and mylar has it as another).
Post Reply