Searching but not searching

Post any problems / bugs / issues that are Mylar-related in here.
dond72
Posts: 6
Joined: Wed Jul 31, 2019 9:40 am

Searching but not searching

Post by dond72 » Wed Jul 31, 2019 9:56 am

Hi, newb here.

Installed two days ago but I cannot get to download anything. I tried with multiple searcher configuration and nothing seems to work. It searches but won't snatch anytthing.

Log follows:
31-jul-2019 09:29:21 - INFO :: Thread-12 : webserve.py:queueissue:1430 : Initiating manual search for House of X issue: 1
31-jul-2019 09:29:21 - INFO :: Thread-12 : webserve.py:queueissue:1473 : [WANTED-SEARCH] Now Queueing House of X (2019) #1 for search
31-jul-2019 09:29:26 - INFO :: SEARCH-QUEUE : helpers.py:search_queue:3145 : [SEARCH-QUEUE] Now loading item from search queue: {'comicname': u'House of X', 'issueid': u'714236', 'seriesyear': u'2019', 'booktype': u'Print', 'issuenumber': u'1', 'comicid': u'120309'}
31-jul-2019 09:29:26 - INFO :: SEARCH-QUEUE : search.py:NZB_SEARCH:513 : Shhh be very quiet...I'm looking for House of X issue: 1 (2019) using ETTV (torznab).
31-jul-2019 09:29:26 - INFO :: SEARCH-QUEUE : search.py:NZB_SEARCH:733 : Pausing for 60 seconds before continuing to avoid hammering
31-jul-2019 09:29:27 - INFO :: SEARCH-QUEUE : search.py:NZB_SEARCH:805 : no errors on data retrieval...proceeding

User avatar
evilhero
Site Admin
Posts: 2383
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Searching but not searching

Post by evilhero » Thu Aug 01, 2019 5:08 am

Your search queue is dead from the looks of it. Only fix (usually happens when the search queue encounters an error - as it can never recover properly due to the locking of the queue) is to restart Mylar.

If you have Public Torrents enabled within Mylar, disable them as well. WWT isn't coming back and that's all the Public Torrents use.

Otherwise if it doesn't work still - we'll need to see the full debug logs showing a search from the start to the end of the given search.

dond72
Posts: 6
Joined: Wed Jul 31, 2019 9:40 am

Re: Searching but not searching

Post by dond72 » Sun Aug 04, 2019 7:25 pm

I got the torrents working sometimes, but the ddl doesn't do nothing, this is what I get:

2019-08-04 19:22:25 DEBUG usedate: 2019-07-17
2019-08-04 19:22:25 DEBUG date used is : 2019-07-17
2019-08-04 19:22:25 DEBUG store date used is : 2019-07-17
2019-08-04 19:22:25 DEBUG size given as: 47.0 MB
2019-08-04 19:22:25 DEBUG comsize_b: 49283072
2019-08-04 19:22:25 DEBUG sub: Aquaman #50 (2019)
2019-08-04 19:22:25 DEBUG checking search result: Aquaman #50 (2019)
2019-08-04 19:22:25 DEBUG The Brave and the Bold Vol. 3 # [503 M]
2019-08-04 19:22:25 DEBUG Aquaman 000 - 033 Plus Annual Free Download [2.0 G]
2019-08-04 19:22:25 DEBUG Justice League #0 - 50 [2.6 G]
2019-08-04 19:22:25 DEBUG Aquaman #32 (2018) [34 M]
2019-08-04 19:22:25 DEBUG Aquaman Vol. 1 - 8 + TPB + Extras (Ultimate Collection) (1941-2018) [16.3 G]
2019-08-04 19:22:25 DEBUG Aquaman - Rebirth #1 + #1 - 48 [1.8 G]
2019-08-04 19:22:25 DEBUG Aquaman #49 (2019) [27 M]
2019-08-04 19:22:25 DEBUG Aquaman #50 [77 M]
2019-08-04 19:22:25 DEBUG Aquaman #50 (2019) [47 M]
2019-08-04 19:22:25 INFO There are 12 results
2019-08-04 19:22:23 DEBUG Sending request to DDL site for : Aquaman 50
2019-08-04 19:22:23 DEBUG findloop: 0 / findcount: 1
2019-08-04 19:22:23 INFO Shhh be very quiet...I'm looking for Aquaman issue: 50 (2019) using ddl.

User avatar
evilhero
Site Admin
Posts: 2383
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Searching but not searching

Post by evilhero » Sun Aug 04, 2019 8:39 pm

Is that the entire debug log? What happens after the use date line? (also use the actual mylar.log files, they're more informative as they contain actual code lines)

Do you have a ddl_location specified in your config.ini? If you do - does the directory exist? If you don't - can you try and put a path in there that's accessible by the user running mylar (meaning full rights), and exists?

You can also check the status of your direct downloads by going into Manage / Manage DDL.

dond72
Posts: 6
Joined: Wed Jul 31, 2019 9:40 am

Re: Searching but not searching

Post by dond72 » Mon Aug 05, 2019 4:53 pm

DDL folder is set in the config.ini to the same folder as the torrent download folder.

Doesn't seem to add anything to the DDL queue.

[DDL]
ddl_autoresume = True
enable_ddl = True
ddl_location = /Series/Torrent/Finished/Comic/
allow_packs = False

The log provides the following:

05-ago-2019 16:44:26 - INFO :: SEARCH-QUEUE : search.py:NZB_SEARCH:513 : Shhh be very quiet...I'm looking for Aquaman issue: 50 (2019) using ddl.
05-ago-2019 16:44:26 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:577 : findloop: 0 / findcount: 1
05-ago-2019 16:44:26 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:623 : Sending request to DDL site for : Aquaman 50
05-ago-2019 16:44:27 - INFO :: SEARCH-QUEUE : getcomics.py:search_results:89 : There are 12 results
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman #50 (2019) [47 M]
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman #50 [77 M]
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman #49 (2019) [27 M]
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman - Rebirth #1 + #1 - 48 [1.8 G]
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman Vol. 1 - 8 + TPB + Extras (Ultimate Collection) (1941-2018) [16.3 G]
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman #32 (2018) [34 M]
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Justice League #0 - 50 [2.6 G]
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman 000 - 033 Plus Annual Free Download [2.0 G]
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : The Brave and the Bold Vol. 3 # [503 M]
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:846 : checking search result: Aquaman #50 (2019)
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:856 : sub: Aquaman #50 (2019)
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:905 : comsize_b: 49283072
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:942 : size given as: 47.0 MB
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:988 : store date used is : 2019-07-17
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:989 : date used is : 2019-07-17
05-ago-2019 16:44:27 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:1032 : usedate: 2019-07-17
05-ago-2019 16:47:02 - INFO :: MainThread : __init__.py:initialize:186 : Checking to see if the database has all tables....
05-ago-2019 16:47:02 - INFO :: MainThread : __init__.py:csv_load:1371 : Populating Base Exception listings into Mylar....
05-ago-2019 16:47:02 - INFO :: MainThread : __init__.py:csv_load:1373 : Populating Custom Exception listings into Mylar....
05-ago-2019 16:47:02 - INFO :: MainThread : __init__.py:dbcheck:1317 : Ensuring DB integrity - Removing all Erroneous Comics (ie. named None)
05-ago-2019 16:47:02 - INFO :: MainThread : __init__.py:dbcheck:1319 : Correcting Null entries that make the main page break on startup.
05-ago-2019 16:47:02 - INFO :: MainThread : __init__.py:initialize:200 : Successfully discovered local IP and locking it in as : 192.168.2.180
05-ago-2019 16:47:02 - INFO :: MainThread : __init__.py:initialize:262 : Remapping the sorting to allow for new additions.
05-ago-2019 16:47:02 - INFO :: MainThread : helpers.py:ComicSort:760 : Sucessfully ordered 7 series in your watchlist.
05-ago-2019 16:47:02 - INFO :: MainThread : filechecker.py:validateAndCreateDirectory:1619 : [DIRECTORY-CHECK] Found comic directory: /opt/Mylar
05-ago-2019 16:47:02 - INFO :: MAIN : __init__.py:daemonize:320 : Daemonized to PID: 3398
05-ago-2019 16:47:02 - INFO :: MAIN : webstart.py:initialize:72 : Starting Mylar on http://0.0.0.0:8090/
05-ago-2019 16:47:03 - INFO :: MAIN : versioncheck.py:getVersion:119 : Branch detected & set to : development
05-ago-2019 16:47:03 - INFO :: MAIN : versioncheck.py:versionload:311 : Version information: development [15aadaaa23ba8c48aa34b5e3bc9d7a9287d00ce5]
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:start:356 : DB Updater sccheduled to fire every 5 minutes
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:queue_schedule:525 : [SEARCH-QUEUE] Attempting to background load the search queue....
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:queue_schedule:528 : [SEARCH-QUEUE] Successfully started the Search Queuer...
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:queue_schedule:536 : [POST-PROCESS-QUEUE] Post Process queue enabled & monitoring for api requests....
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:queue_schedule:539 : [POST-PROCESS-QUEUE] Succesfully started Post-Processing Queuer....
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:queue_schedule:548 : [DDL-QUEUE] DDL Download queue enabled & monitoring for requests....
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:queue_schedule:551 : [DDL-QUEUE:] Succesfully started DDL Download Queuer....
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:start:405 : [WEEKLY] Checking for existance of Weekly Comic listing...
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:start:463 : [FOLDER MONITOR] Enabling folder monitor for : /Series/Torrent/Finished every 5 minutes.
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:start:471 : Firing up the Background Schedulers now....
05-ago-2019 16:47:03 - INFO :: MAIN : __init__.py:start:475 : Background Schedulers successfully started...
05-ago-2019 16:48:42 - INFO :: CP Server Thread-8 : webserve.py:toggleVerbose:4015 : Verbose (DEBUG) logging is enabled
05-ago-2019 16:48:42 - DEBUG :: CP Server Thread-8 : webserve.py:toggleVerbose:4016 : If you can read this message, debug logging is now working
05-ago-2019 16:48:51 - DEBUG :: Thread-12 : webserve.py:queueissue:1339 : ComicID: 91738
05-ago-2019 16:48:51 - DEBUG :: Thread-12 : webserve.py:queueissue:1340 : mode: want
05-ago-2019 16:48:51 - INFO :: Thread-12 : webserve.py:queueissue:1430 : Initiating manual search for Aquaman issue: 50
05-ago-2019 16:48:51 - INFO :: Thread-12 : webserve.py:queueissue:1473 : [WANTED-SEARCH] Now Queueing Aquaman (2016) #50 for search
05-ago-2019 16:48:53 - INFO :: SEARCH-QUEUE : helpers.py:search_queue:3145 : [SEARCH-QUEUE] Now loading item from search queue: {'comicname': u'Aquaman', 'issueid': u'713770', 'seriesyear': u'2016', 'booktype': u'Print', 'issuenumber': u'50', 'comicid': u'91738'}
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:63 : Publisher is : DC Comics
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:71 : Issue Title given as : amnesty, part 1: the call
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:102 : Checking for torrent enabled.
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:153 : nzbprovider(s): []
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:156 : There are 0 torrent providers you have selected.
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:161 : There are : 0 nzb providers you have selected
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:166 : there are 1 Direct Download providers that are currently enabled.
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:180 : search provider order is ['DDL']
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:247 : calpha/cnumber: None / None
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:search_init:283 : Initiating Search via : api
05-ago-2019 16:48:53 - INFO :: SEARCH-QUEUE : search.py:NZB_SEARCH:513 : Shhh be very quiet...I'm looking for Aquaman issue: 50 (2019) using ddl.
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:577 : findloop: 0 / findcount: 1
05-ago-2019 16:48:53 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:623 : Sending request to DDL site for : Aquaman 50
05-ago-2019 16:48:54 - INFO :: SEARCH-QUEUE : getcomics.py:search_results:89 : There are 12 results
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman #50 (2019) [47 M]
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman #50 [77 M]
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman #49 (2019) [27 M]
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman - Rebirth #1 + #1 - 48 [1.8 G]
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman Vol. 1 - 8 + TPB + Extras (Ultimate Collection) (1941-2018) [16.3 G]
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman #32 (2018) [34 M]
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Justice League #0 - 50 [2.6 G]
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : Aquaman 000 - 033 Plus Annual Free Download [2.0 G]
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : getcomics.py:search_results:161 : The Brave and the Bold Vol. 3 # [503 M]
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:846 : checking search result: Aquaman #50 (2019)
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:856 : sub: Aquaman #50 (2019)
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:905 : comsize_b: 49283072
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:942 : size given as: 47.0 MB
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:988 : store date used is : 2019-07-17
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:989 : date used is : 2019-07-17
05-ago-2019 16:48:54 - DEBUG :: SEARCH-QUEUE : search.py:NZB_SEARCH:1032 : usedate: 2019-07-17
05-ago-2019 16:50:13 - INFO :: Thread-13 : searchit.py:run:28 : [SEARCH] Running Search for Wanted.

User avatar
evilhero
Site Admin
Posts: 2383
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Searching but not searching

Post by evilhero » Mon Aug 05, 2019 5:10 pm

Does /Series/Torrent/Finished/Comic/ exist, and does the user running Mylar have full access (rwx) to that specific directory ? If Comic/ doesn't exist it would fail due to it not existing (there's a PR fix for this still to come).

Also, there's no need to folder monitor the DDL downloads. Once a DDL is downloaded successfully it immediately gets sent to post-processing, so there's no delay / monitor required. Having the folder monitor monitor that directory as well might cause race problems as the DDL completes it tries to post-process it at the same time as the folder monitor fires off against it.

dond72
Posts: 6
Joined: Wed Jul 31, 2019 9:40 am

Re: Searching but not searching

Post by dond72 » Mon Aug 05, 2019 5:21 pm

Mylar process
python 3194 dond72 4u IPv4 38175 0t0 TCP *:8090 (LISTEN)

Permissions for the folder
drwxrwxr-x 2 dond72 dond72 4096 ago 5 16:43 Comic

As you can see the user are the same, and permissions seem to be ok.

User avatar
evilhero
Site Admin
Posts: 2383
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Searching but not searching

Post by evilhero » Mon Aug 05, 2019 6:08 pm

Works fine here, so if it's not perms - then odds are from those logs it looks like your timestamps are being formatted to something other than a standard timestamp (05-ago-2019 16:44:26) - not sure exactly what's going on with your setup, but that's not normal (it should be the Month instead of just the word ago).

Based on your paths, I'm going to assume your running Mylar as a docker - in which case I haven't the foggiest notion of how to fix the date thing as I don't run/use docker. Of course even if you weren't running docker, I still don't have any idea of how to resolve this - as it's taking your OS date and formatting it based on your OS settings - of which I know nothing of as you failed to provide that information.

dond72
Posts: 6
Joined: Wed Jul 31, 2019 9:40 am

Re: Searching but not searching

Post by dond72 » Mon Aug 05, 2019 6:11 pm

Maybe it has something to do with the OS being in Spanish, gonna try and solve that.

What information about the OS would be helpful to you?

Would it help to run it outside of docker? I used docker just because I installed Mono with docker.

When you say the month, you mean like AUg or just the number?

User avatar
evilhero
Site Admin
Posts: 2383
Joined: Sat Apr 20, 2013 3:43 pm
Contact:

Re: Searching but not searching

Post by evilhero » Mon Aug 05, 2019 6:28 pm

Mylar doesn''t use docker - it's python based, so no mono required (ie. it's not based on radarr/lidarr/sonarr, etc - sonarr happened to change their name from nzbdrone after mylar was already around for awhile).

If you can, do the following:
- get to a command/shell/prompt.
- start up the python cli by typing in just 'python' (without quotes)
- type in the following, hitting enter after each line:

Code: Select all

     import locale
     locale.getdefaultlocale()
- it will spit back 2 items (ie. 'en_CA', 'UTF-8') - the first being your language, the 2nd being your character set.

We've tested against german, french, etc - so you it's possible you might not be running in UTF-8 for the character set (so it doesn't know how to handle the special characters in some month names), which would cause problems - but getting those 2 items from that locale command will help us to troubleshoot more.

Post Reply