Welcome to the Invelos forums. Please read the forum rules before posting.

Read access to our public forums is open to everyone. To post messages, a free registration is required.

If you have an Invelos account, sign in to post.

Invelos Forums->Posts by agent_bitter Page: 1  Previous   Next
Message Details
A while back you explained that there is this problem with IMDb that not all the names are loaded at the same time, see here:

Quoting DJ Doena:
Quote:
Yeah the problem is that IMDb switches more and more away from the classic (i.e. 1990s and 2000s) way of delivering web pages and switches more to the modern load-more-data-as-required style that is in use almost everywhere nowadays (and for good reason). For example if you have a chat app on your phone that's mostly just a website disguised as an app and when you see the three dots when someone's typing that is this modern dynamically loading of new elements into the webpage.

Unfortunately for us the same is true with the crew data. The website I get delivered from IMDb only contains the initial bulk load of data and any browser would then be able to instruct the web server to deliver more data. Unfortunately I cannot simulate this.


And I have to ask one last time: there is no way to circumvent this problem at all? Because after the latest update Cast/Crew Edit isn't able to get more then ten (in numbers: 10) names per department. That means 10 for makeup, 10 for art, 10 for sound and so on. That's... not mutch, so I wanted to make sure that this problem is not solvable right now?

Anyway, your tool is great and it's quite sad that it can't be used to it full potential due to the changes from the IMDb. Keep up the great work!
Posted:
Topic Replies: 757, Topic Views: 71021
Same here. Only the Soundtrack credits get parsed, everything else doesn't work anymore
Posted:
Topic Replies: 757, Topic Views: 71021
Quoting agent_bitter:
Quote:
Quoting DJ Doena:
Quote:
Do you have a concrete movie as example?

This is the case in every movie I try to parse. Like in 100% of movies, choose any and 'other' don't get parsed. From older movies like Lifeforce or Friday the 13. to newer movies like Sin City or Guardians of the Galaxy.

To add to this problem, I found out that the program is not able to parse more then 250 to 300 names in both cast and crew. Therefore, NO movie with that many or more members will get parsed in its entirety. This problem is quite new, but adds to the problem i mentioned before.
Posted:
Topic Replies: 757, Topic Views: 71021
Quoting DJ Doena:
Quote:
Do you have a concrete movie as example?

This is the case in every movie I try to parse. Like in 100% of movies, choose any and 'other' don't get parsed. From older movies like Lifeforce or Friday the 13. to newer movies like Sin City or Guardians of the Galaxy.
Posted:
Topic Replies: 757, Topic Views: 71021
Quoting DJ Doena:
Quote:
try the new version 


I'm not sure if the IMDb changed something again or whatever happened, but there is a small problem in your program again. The 'Additional Crew' doesn't get parsed; quite in general as soon as I include the 'other' credits, it doesn't work as intended. For example, the names credited as get put in the slot of individual roles when I try to parse the 'other' credits. This doesn't happen when i exclude them. It would be very much appreciated if you could take a look at this. Thanks in advance!
Posted:
Topic Replies: 757, Topic Views: 71021
Invelos Forums->Posts by agent_bitter Page: 1  Previous   Next