not able to search comics

[Jeroen]

Since about two days I am not able to do any searches in Mylar. I get this 503 every time I search anything:

Code: Select all

500 Internal Server Error

The server encountered an unexpected condition which prevented it from fulfilling the request.

Traceback (most recent call last):
  File "/volume1/Mylar/cherrypy/_cprequest.py", line 645, in respond
    response.body = self.handler()
  File "/volume1/Mylar/cherrypy/lib/encoding.py", line 188, in __call__
    self.body = self.oldhandler(*args, **kwargs)
  File "/volume1/Mylar/cherrypy/_cpdispatch.py", line 29, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/volume1/Mylar/mylar/webserve.py", line 205, in searchit
    searchresults, explicit = mb.findComic(name, mode, issue=None, explicit=explicit)
TypeError: 'bool' object is not iterable

And the log shows this:

Code: Select all

2015-09-11 08:12:52	ERROR	There was a major problem retrieving data from ComicVine - on their end. You'll have to try again later most likely.
2015-09-11 08:12:52	ERROR	err : HTTP Error 403: Forbidden

Could this mean that I have been blocked at comicvine due to too much traffic? I got a notification at the comicvine website asking me to do the captcha thing to confirm I am not a bot. Which I have done but it doesn't seem to have made a difference. My ISP has suffered from several ddos attacks recently, so maybe that has something to do with it. Anyone else experiencing this problem?

[evilhero]

No problems on this end - make sure that your comicvine api key is correct within Mylar.

It's possible that you hit the api limit that they're enforcing now - for general updating it's 400 hits / 15 minutes, but for searches it's 500 hits / 24 hours. I'm guessing that if you hit the search limit, they would block it with that type of message.

One way to know for sure is to go to the comicvine api website, and sign in using your credentials. You should get some notification about your api key having problems if it were blocked (or you wouldn't be able to sign in kinda deal).

[Jeroen]

Thanks evilhero

I have been in contact with the comicvine people, unfortunately I have been blocked because of very high traffic originating from my ISP's range. I am not hitting those limits by any stretch, but my ISP has suffered from several ddos attacks lately which probably was the cause of comicvine blocking the entire ISP.

As a result I will not be able tag my comics for probably as long as I am with this ISP... which is the only option for me.

Really frustrating to be the victim of something like this, and sadly the end of keeping an organized collection. Really bummed out, but I don't think there's anything I can do about it.

Thanks a lot for your time and Mylar, keep up this great project!

[evilhero]

Banning a whole isp is a bit drastic, bit if they have no other alternative then I guess that's the only course of action they can take.

Aside from using a proxy (which would be hit or miss) or a vpn ( which would work a treat easily ) there's probably not much else that can be done

Try not to make mention of mylar in the cv forums or when talking to their support if you can - raising a flag about mylar might make them feel like banning the entire app from usage (not to its usage of the api, but as to what mylar does).

[Jeroen]

definitely drastic yeah, but I can understand it for sure. luckily after some e-mails I got myself whitelisted, so thankfully I am able to keep using Mylar

[neuikc]

I'm having something similar happen, do you think it's a API ban on CV's side also?

Code: Select all

500 Internal Server Error

The server encountered an unexpected condition which prevented it from fulfilling the request.

Traceback (most recent call last):
  File "/opt/mylar/cherrypy/_cprequest.py", line 645, in respond
    response.body = self.handler()
  File "/opt/mylar/cherrypy/lib/encoding.py", line 188, in __call__
    self.body = self.oldhandler(*args, **kwargs)
  File "/opt/mylar/cherrypy/_cpdispatch.py", line 29, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/opt/mylar/mylar/webserve.py", line 208, in searchit
    searchresults, explicit = mb.findComic(name, mode, issue=None, explicit=explicit)
  File "/opt/mylar/mylar/mb.py", line 132, in findComic
    searched = pullsearch(comicapi, comicquery, 0, explicit, type)
  File "/opt/mylar/mylar/mb.py", line 71, in pullsearch
    file = urllib2.urlopen(PULLURL)
  File "/usr/lib/python2.7/urllib2.py", line 154, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 469, in error
    result = self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 656, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "/usr/lib/python2.7/urllib2.py", line 431, in open
    response = self._open(req, data)
  File "/usr/lib/python2.7/urllib2.py", line 449, in _open
    '_open', req)
  File "/usr/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 1227, in http_open
    return self.do_open(httplib.HTTPConnection, req)
  File "/usr/lib/python2.7/urllib2.py", line 1200, in do_open
    r = h.getresponse(buffering=True)
  File "/usr/lib/python2.7/httplib.py", line 1127, in getresponse
    response.begin()
  File "/usr/lib/python2.7/httplib.py", line 453, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python2.7/httplib.py", line 409, in _read_status
    line = self.fp.readline(_MAXLINE + 1)
  File "/usr/lib/python2.7/socket.py", line 480, in readline
    data = self._sock.recv(self._rbufsize)
error: [Errno 104] Connection reset by peer

I'm not getting any errors showing in my log though.

[evilhero]

I'm having something similar happen, do you think it's a API ban on CV's side also?

Yep, that was the api ban that was happening on their side. The restrictions were lifted a day or so ago, so you should be back in the ok for the time being. Not sure exactly what they're going to try next, but this last one basically marked any IP that was sending multiple api requests to the CV server as malicious and blacklisted those IPs (according to their forums at least).