Posted on Uncategorized

TMDB scraper failures for previously working movies

Hi,

I've a folder with a couple of hundred movies which - until today - have been quite happily retrieving data using the TMDB scraper. However, today I tried and failed to add a couple of new ones which I could clearly see were on TMDB. It further turns out that if I remove then re-add (and rescan) the source, many of the movies that used to work are no longer identified. Some 90 or so are now failing.

An extract from the kodi.log for one that works and one that doesn't shows:

Code:
18:04:55.801 T:12260   DEBUG: VideoInfoScanner: Scanning dir 'nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/' as not in the database
18:04:55.815 T:12260   DEBUG: VideoInfoScanner: No (new) information was found in dir nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/
18:04:55.925 T:12260   DEBUG: VideoInfoScanner: Scanning dir 'nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/At World's End (2007)/' as not in the database
18:04:55.937 T:12260   DEBUG: CVideoDatabase::GetMovieId (nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/At World's End (2007)/Pirates of the Caribbean At Worlds End (2007).mp4), query = select idMovie from movie where idFile=4391
18:04:55.944 T:12260   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/At World's End (2007)/Pirates of the Caribbean At Worlds End (2007).mp4'
18:04:55.944 T:12260   DEBUG: ADDON::CScraper::FindMovie: Searching for 'At World's End' using The Movie Database scraper (path: 'C:\Users\chris\AppData\Roaming\Kodi\addons\metadata.themoviedb.org', content: 'movies', version: '3.9.3')
18:04:55.959 T:12260   DEBUG: scraper: CreateSearchUrl returned <url>http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&amp;query=At%20World%27s%20End&amp;year=2007&amp;language=en</url>
18:04:55.959 T:12260   DEBUG: CurlFile::Open(14AF8558) http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=At%20World%27s%20End&year=2007&language=en
18:04:55.998 T:12260   DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=At%20World%27s%20End&year=2007&language=en"
18:04:55.998 T:12260   DEBUG: scraper: GetSearchResults returned <results></results>
18:04:55.998 T:12260   DEBUG: ADDON::CScraper::FindMovie: Searching for 'At World's End' using The Movie Database scraper (path: 'C:\Users\chris\AppData\Roaming\Kodi\addons\metadata.themoviedb.org', content: 'movies', version: '3.9.3')
18:04:55.999 T:12260   DEBUG: scraper: CreateSearchUrl returned <url>http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&amp;query=At%20World%27s%20End&amp;year=&amp;language=en</url>
18:04:55.999 T:12260   DEBUG: CurlFile::Open(14AF8558) http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=At%20World%27s%20End&year=&language=en
18:04:56.040 T:12260   DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=At%20World%27s%20End&year=&language=en"
18:04:56.041 T:12260   DEBUG: scraper: GetSearchResults returned <results></results>
18:04:56.041 T:12260 WARNING: No information found for item 'nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/At World's End (2007)/Pirates of the Caribbean At Worlds End (2007).mp4', it won't be added to the library.
18:04:56.041 T:12260   DEBUG: VideoInfoScanner: No (new) information was found in dir nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/At World's End (2007)/
18:04:56.080 T:12260   DEBUG: VideoInfoScanner: Scanning dir 'nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/At World's End (2007)/extrafanart/' as not in the database
18:04:56.080 T:12260   DEBUG: VideoInfoScanner: No (new) information was found in dir nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/At World's End (2007)/extrafanart/
18:04:56.109 T:12260   DEBUG: VideoInfoScanner: Scanning dir 'nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/At World's End (2007)/extrathumbs/' as not in the database
18:04:56.109 T:12260   DEBUG: VideoInfoScanner: No (new) information was found in dir nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/At World's End (2007)/extrathumbs/
18:04:56.202 T:12260   DEBUG: VideoInfoScanner: Scanning dir 'nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/Dead Man's Chest (2006)/' as not in the database
18:04:56.208 T:12260   DEBUG: CVideoDatabase::GetMovieId (nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/Dead Man's Chest (2006)/Pirates of the Caribbean Dead Mans Chest (2006).mp4), query = select idMovie from movie where idFile=4392
18:04:56.214 T:12260   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'nfs://192.168.0.2/mnt/HD/HD_a2/Public/Shared Videos/Movies/Pirates Of The Caribbean/Dead Man's Chest (2006)/Pirates of the Caribbean Dead Mans Chest (2006).mp4'
18:04:56.214 T:12260   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Dead Man's Chest' using The Movie Database scraper (path: 'C:\Users\chris\AppData\Roaming\Kodi\addons\metadata.themoviedb.org', content: 'movies', version: '3.9.3')
18:04:56.223 T:12260   DEBUG: scraper: CreateSearchUrl returned <url>http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&amp;query=Dead%20Man%27s%20Chest&amp;year=2006&amp;language=en</url>
18:04:56.223 T:12260   DEBUG: CurlFile::Open(14AFAC20) http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=Dead%20Man%27s%20Chest&year=2006&language=en
18:04:56.267 T:12260   DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=Dead%20Man%27s%20Chest&year=2006&language=en"
18:04:56.267 T:12260   DEBUG: scraper: GetSearchResults returned <results><entity><title>Pirates of the Caribbean: Dead Man's Chest</title><id>58</id><year>2006</year><url cache="tmdb-en-58.json">http://api.tmdb.org/3/movie/58?api_key=f7f51775877e0bb6703520952b3c7840&amp;language=en</url></entity><entity><title>Pirates of the Caribbean: Dead Man's Chest</title><id>58</id><year>2006</year><url cache="tmdb-en-58.json">http://api.tmdb.org/3/movie/58?api_key=f7f51775877e0bb6703520952b3c7840&amp;language=en</url></entity></results>

In both cases, if I call the API from a browser I get a valid response back from TMDB. Admittedly in this example one does return multiple results and the other does not, but this factor isn't consistent across all failures. However, what does seem to be consistent is the order in which the JSON data is return, and particularly whether the "total_results" field appears at the beginning or end.

E.g. for a failed result, the JSON is:

Code:
{"page":1,"total_results":4,"total_pages":1,"results":[{"vote_count":3612,"id":285,"video":false,"vote_average":6.9,"title":"Pirates of the Caribbean: At World's End","popularity":27.43969,"poster_path":"\/bXb00CkHqx7TPchTGG131sWV59y.jpg","original_language":"en","original_title":"Pirates of the Caribbean: At World's End","genre_ids":[12,14,28],"backdrop_path":"\/8ZgpAftUiYTU76IhUADITa3Ur9n.jpg","adult":false,"overview":"Captain Barbossa, long believed to be dead, has come back to life and is headed to the edge of the Earth with Will Turner and Elizabeth Swann. But nothing is quite as it seems.","release_date":"2007-05-19"},{"vote_count":0,"id":247646,"video":false,"vote_average":0,"title":"The Lion at World's End","popularity":1.065,"poster_path":"\/g03DkgBVjCw6V25m3elrw2NZkdI.jpg","original_language":"en","original_title":"The Lion at World's End","genre_ids":[99,12],"backdrop_path":"\/qe2532dMhyt1oJOOIxYtH7iS8tg.jpg","adult":false,"overview":"The astonishing true story of a zoo-born lion who found himself in the pet department of Harrods, then the cellar of an antique shop in London and, ultimately the wilds of Africa.","release_date":"1971-02-28"},{"vote_count":8,"id":19306,"video":false,"vote_average":5.4,"title":"At World's End","popularity":1.209159,"poster_path":"\/kyx08K6qBzXbepULUOu7EfXEOgO.jpg","original_language":"da","original_title":"Ved verdens ende","genre_ids":[12,28,35,53],"backdrop_path":"\/c1D9mKNYukz0q2ToifkaSor8KLJ.jpg","adult":false,"overview":"An english tv-team discovers a special white flower in the indonesian rainforest, but they never get to investegate it further, before the danish recluse Severin has shot them down. A danish special enforcement with a psychiatrist in front is sent off, and they find out, that Severin claims, that he is 129 years old, and it's the flower, which keeps him young. Soon all hunts the white flower, which apparently gives eternal life.","release_date":"2009-10-09"},{"vote_count":28,"id":203351,"video":false,"vote_average":2.1,"title":"Atlantic Rim","popularity":1.020435,"poster_path":"\/9kgK6GpzqreO8DUbLY1L4QD1nrC.jpg","original_language":"en","original_title":"Atlantic Rim","genre_ids":[28,878],"backdrop_path":"\/kX83lWzst7U7z4zRbykv1Zw3VVY.jpg","adult":false,"overview":"When monsters suddenly appear from the bottom of the Atlantic Ocean, a special team pilots giant robots to combat the new threat.","release_date":"2013-07-09"}]}

Compared to a successful result where the total_results appears at the end of the JSON:

Code:
{"page":1,"results":[{"poster_path":"\/waFr5RVKaQ9dzOt3nQuIVB1FiPu.jpg","adult":false,"overview":"Captain Jack Sparrow works his way out of a blood debt with the ghostly Davey Jones, he also attempts to avoid eternal damnation.","release_date":"2006-06-20","genre_ids":[12,14,28],"id":58,"original_title":"Pirates of the Caribbean: Dead Man's Chest","original_language":"en","title":"Pirates of the Caribbean: Dead Man's Chest","backdrop_path":"\/hdHgIcljPHli4xaJGt0INz8Gn3J.jpg","popularity":21.639369,"vote_count":4154,"video":false,"vote_average":6.9}],"total_results":1,"total_pages":1}

This behaviour seems consistent in all the results I've looked at - if the total_results comes at the end then Kodi can parse the response. If it comes at the start, Kodi cannot parse the response. The number of results returned seems to have no bearing on success or failure (or where the total_results field is placed).

Has anyone else seen this behaviour?

Chris

Posted on Uncategorized

Hungary

#EXTM3U #EXTINF:-1,Cinemax 2 Europe (HUN) http://tv.share1.la/live/bZcJ8Ghudq/channel/17731.ts #EXTINF:-1,Cinemax (HUN) http://tv.share1.la/live/bZcJ8Ghudq/channel/15291.ts #EXTINF:-1,Chili (HUN) http://tv.share1.la/live/bZcJ8Ghudq/channel/14571.ts

Posted on Uncategorized

Running Kodi

Thanks to your help I am able to log into Kodi Crypton 17.1. You were right, I am brand new to Kodi and in the learning mode. Now the question is how do I get Kodi to run? Could you please give me a nudge to get me going? Thanks again for your very pr...

Posted on Uncategorized

Power OFF System no dummy (Are you sure?)

I just accidentally hit the 'Power off system' when I mean to click 'Exit'. So the system immediately started shutting down. That made me so upset! Because I lost some data, in another application. I have a multi-screen system, and KODI, just runs in...

Posted on Uncategorized

MySQL library, store images locally?

I've been searching but only find dead ends, things that don't apply, or things that I just don't understand! I'm running Kodi 17 on Raspberry Pi devices (OpenELEC). My content is on a NAS that I built using Nas4Free. I'm using a MySQL database on a...

Posted on Uncategorized

Daily m3u playlist 6 June 2017 (New)

http://ringiptv.net:2500/get.php?username=Kawa&password=Kawa&type=m3uhttp://d4life.dtdns.net:8000/get.php?username=mahon&password=mahon&type=m3uhttp://tvonline.webhop.net:19500/get.php?username=manu123&password=manu123&type=m3uh...

Posted on Uncategorized

New Videos not found on The Movie Database

Hello, since yesterday, new videos are not found in The Movie Database. I have added some movies on my Synology NAS. For typical they are not automatically found in the movie database, because I have some extra extensions in the filename which I wont...

Posted on Uncategorized

Need help setting up an OTA antenna to kodi 17

Noob here, but learning... Im running kodi 17 on a nvidia shield. I have an OTA antenna i want to hook up to kodi to be able to view and record channels from it using kodi PVR and EPG. I have looked at the wiki for how to do this, but I'm still confus...

Posted on Uncategorized

Most Movies not in Library

Hi everyone,

I've been struggling with this problem for a while now, and I couldn’t find a solution in the wiki or forum. My Movies library only contains about one fourth of all my movies. They are all in the same folder, and thus part of the same source. I thought there might be a naming problem, but I checked a few of the missing movies and they were named correctly (exact name from TheMovieDB, no additional information). I also tried adding they year, but to no avail. For example, I have a movie called “8 Mile.mkv” that’s missing in the library. I renamed it “8 Mile (2002).mkv”, re-scanned the source and it’s still not showing up. The problem seems to occur for both .mkv and .mp4 files.

When I access the movies through Videos/Files/myMoviesFolder, they all show up and can be played without a problem. I also noticed that the movies not showing up in the Movies library show up with the file extension (.mp4, .mkv, ...) in the list under Videos/File/myMoviesFolder, but the rest don't have a file extension there (which I guess must mean they were correctly matched and their file name was replaced by the title).

Does anyone have an idea what could be the problem? Thanks in advance!

FYI: I'm using Kodi 17.3 on Windows 10, the files are stored on a Samba NAS.

Posted on Uncategorized

Subtitle help needed.

Hi there



I’m watching Game of Thrones on Kodi box via Isteam and everything fine apart from when they speak in another language the subtitles don’t come up. I followed the instructions of installing Subscene and have installed and added it successfully to the language part in settings.



However when I tried to download the subtitles and match with the same speed link type file like 720p or HD type file it does not Sync correctly and it is all audio subtitles that are displayed not just the different language parts as I said it doesn’t sync at the same speed when playing.



I’ve tried to link up the same subtitle download speed as the file speed episode type file I’m watching and it still doesn’t sync up correctly.



I’ve tried read up on how to change the subtitle language to only display a non-language type but I can’t find that option on my language settings on my box.



I don’t much about files names/codes tbh, when I go to watch an episode I choose a random link I think might work or choose one that is title HD high quality named one.



I’ve also tried to search a program name and put in with English subtitles and the search engine doesn’t work.



Please can you advise of a work around for this issue?



Thanks Frown

Posted on Uncategorized

Scrapping issue?

Hi,

Got to make a fresh installation of Kodi and then got a weird issue: a lot of my localy stored movies do not show in library

What already come to my mind:

- corrupted files: remade some of my rip did not solve issue
- HDD issue: put files on another HDD did not solve issue
- skin issue: fresh install of kodi with no other addons did not solve issue

As an exemple, we will take "The hobbit: The desolation of Smaug"

First, here is the folder structure:
[Image: 170605042825464557.png]

The folder "Movies" being set as source

And here are the scrapper settings:
[Image: 170605042825263095.png]

And a proof that tmdb as french data about this movie:
[Image: 17060504282685709.png]

This setup works since I use kodi, but today i got issues: this movie (and some other one) does not show!
[Image: 170605042825747118.png]

As you can see, the movie is missing

And kodi log tells that the scrapper did not find info for this movie

Code:
15:45:21.868 T:11136   DEBUG: VideoInfoScanner: Scanning dir 'E:\Movies\Le Hobbit La désolation de Smaug (2013)\' as not in the database
15:45:21.871 T:11136   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'E:\Movies\Le Hobbit La désolation de Smaug (2013)\Le Hobbit La désolation de Smaug (2013).mkv'
15:45:21.871 T:11136   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Le Hobbit La désolation de Smaug' using The Movie Database scraper (path: 'C:\Users\Cardo\AppData\Roaming\Kodi\addons\metadata.themoviedb.org', content: 'movies', version: '3.9.3')
15:45:21.875 T:11136   DEBUG: scraper: CreateSearchUrl returned <url>http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&amp;query=Le%20Hobbit%20La%20d%c3%a9solation%20de%20Smaug&amp;year=2013&amp;language=fr</url>
15:45:21.875 T:11136   DEBUG: CurlFile::Open(00000232C5604D00) http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=Le%20Hobbit%20La%20d%c3%a9solation%20de%20Smaug&year=2013&language=fr
15:45:21.939 T:8124   DEBUG: CCurlFile::GetMimeType - http://image.tmdb.org/t/p/original/AstZev5dERXgfuxVGJeiygq0C9f.jpg -> image/jpeg
15:45:21.939 T:8124   DEBUG: CurlFile::Open(00000232C1376F00) http://image.tmdb.org/t/p/original/AstZev5dERXgfuxVGJeiygq0C9f.jpg
15:45:21.941 T:11844   DEBUG: Skin Helper Service --> Kodi_Monitor: sender xbmc - method: VideoLibrary.OnUpdate  - data: {"item":{"id":11,"type":"movie"},"transaction":true}
15:45:21.948 T:6840   DEBUG: Skin Helper Widgets --> Kodi_Monitor: sender xbmc - method: VideoLibrary.OnUpdate  - data: {"item":{"id":11,"type":"movie"},"transaction":true}
15:45:21.948 T:6840   DEBUG: Skin Helper Widgets --> Video database changed - type: movie - refreshing widgets....
15:45:21.972 T:11136   DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=Le%20Hobbit%20La%20d%c3%a9solation%20de%20Smaug&year=2013&language=fr"
15:45:21.972 T:11136   DEBUG: scraper: GetSearchResults returned <results></results>
15:45:21.972 T:11136   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Le Hobbit La désolation de Smaug' using The Movie Database scraper (path: 'C:\Users\Cardo\AppData\Roaming\Kodi\addons\metadata.themoviedb.org', content: 'movies', version: '3.9.3')
15:45:21.972 T:11136   DEBUG: scraper: CreateSearchUrl returned <url>http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&amp;query=Le%20Hobbit%20La%20d%c3%a9solation%20de%20Smaug&amp;year=&amp;language=fr</url>
15:45:21.972 T:11136   DEBUG: CurlFile::Open(00000232C5604D00) http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=Le%20Hobbit%20La%20d%c3%a9solation%20de%20Smaug&year=&language=fr
15:45:22.023 T:11136   DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "http://api.tmdb.org/3/search/movie?api_key=f7f51775877e0bb6703520952b3c7840&query=Le%20Hobbit%20La%20d%c3%a9solation%20de%20Smaug&year=&language=fr"
15:45:22.023 T:11136   DEBUG: scraper: GetSearchResults returned <results></results>
15:45:22.023 T:11136 WARNING: No information found for item 'E:\Movies\Le Hobbit La désolation de Smaug (2013)\Le Hobbit La désolation de Smaug (2013).mkv', it won't be added to the library.
15:45:22.023 T:11136   DEBUG: VideoInfoScanner: No (new) information was found in dir E:\Movies\Le Hobbit La désolation de Smaug (2013)\

Full log: https://drive.google.com/open?id=0B8FpSB...XBjdHRBMDQ (sorry log was too big for pastebin.com)

Hope someone will find where the issue could be...