1

Closed

XBMC-TMDB scraper hangs MC

description

In the 3.5.04b release scraping using the XBMC-TMDB scraper is causing a hang until windows says the program needs to be closed.

Details: Movies are stored in the following format:
Z:\Movies\MovieName1\VIDEO_TS\Video_TS.ifo, etc.
Z:\Movies\MovieName2\VIDEO_TS\Video_TS.ifo, etc.

I have previously scraped hundreds of movies using a mixture of IMDB and TMDB (when the movie was not available on IMDB).

Currently, I'm trying to scrape "Scooby-Doo! and the Robots (2011)" using the XBMC-TMDB scraper because this movie does not appear in IMDB. Everytime I try, the program hangs until windows asks to force shutdown of the program.

I tried to scrape the same movie using XBMC-IMDB scraper and it worked fine except that it grabbed the wrong movie as this movie is not listed in IMDB. Same thing with the standard IMDB scraper. Worked fine, but got the wrong movie.
Closed Jan 29 at 6:48 AM by vbat99
Issue resolved. CLosed.

comments

HueyHQ wrote Aug 10, 2012 at 8:18 AM

I've spent a bit of time looking thru the XBMC scraper code, and by all accounts, it seems to be scraping properly! Mind you, I've tested about three movies, but "Scooby-Doo! and the Robots (2011)" was one of them!
Because of the new TMDb-V3 API, all responses are now JSON only, so there was a bit of tweaking to get it to perform correctly.
I did a quick check with the XBMC IMDb scraper, and it seemed alright if not as comprehensive as MCs built-in IMDb scraper.
Give it a go and see how it looks - I am expecting some quirks but I live in hope!

trpltongue wrote Aug 10, 2012 at 5:30 PM

HueyHQ,

You are the man! TMDB definitely works now. I have come across another issue, perhaps related when I am using the TMDB scraper and have the "enable trailers from hd-trailers.net" set to anything other than "no". I get a system stop error saying "The remote server returned an error: (404) Not Found. URL http://xbmc.hd-trailers.net/movie/scooby-Doo-and-the-Zombies-(2011)"

Not a problem as I just disabled trailers from hd-trailers.net but something I thought you might want to know about.

trpltongue wrote Aug 10, 2012 at 6:57 PM

Also forgot, if I try to "re-scrape" a movie using the tmdb scraper the program hangs indefinitely.

HueyHQ wrote Aug 14, 2012 at 12:30 AM

Thanks for the feedback!

The trailer issue is probably because I hadn't updated the metadata.mc.hdtrailers.net scraper AnotherPhil had added recently - I'm not sure how it is affected but most likely my fault. I haven't looked at it yet because you've worked around it.

The re-scrape was missed too, so I have updated it to use the new API. Unfortunately, the way the scraper is written, it stores the TMDb ID and the IMDb ID both as an <id> tag so MC gets confused over what to do because it doesn't want to re-scrape over what it thinks was the other scraper.

There are two solutions I can think of:
One, is to update your TMDb scraper (tmdb.xml:line 41) to record the IMDB ID as "... output="<imdb_id>\1</imdb_id>" ..."
Two, just force MC to re-scrape anyway, which may have unexpected consequences.

There are pros and cons for each, so as a TMDb user, what thoughts do you have on this?

Sign in to add a comment