INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: 1 [2]   Go Down

Author Topic: BD Folders import in library: installments missed (films)  (Read 4603 times)

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 72536
  • Where did I put my teeth?
Re: BD Folders import in library: installments missed (films)
« Reply #50 on: July 27, 2023, 12:33:48 pm »

Manni,
I'd appreciate it if you'd keep your opinion on where the problem lies to yourself until we know more.  You're repeating yourself, with little hard information.  Nobody is ignoring you.

We've seen stranger problems with NAS drives, for example.

You could also take the caps lock off.
Logged

Manni

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 509
BD Folders import in library: installments missed (films)
« Reply #51 on: July 27, 2023, 12:56:59 pm »

Manni,
I'd appreciate it if you'd keep your opinion on where the problem lies to yourself until we know more.  You're repeating yourself, with little hard information.  Nobody is ignoring you.

We've seen stranger problems with NAS drives, for example.

You could also take the caps lock off.
I have reinstalled MC 28 build 91 and imported the same share.

All the Ghostbusters and John Wick titles are imported correctly. It detects 254 titles (I assume because a few have more than one disc or bonuses), vs 222 with MC 30 (and I believe MC30).

I suspect MattKhan will confirm that he also has some issues when he reimports his shares with MC 31.0.38.

I attach the log and a screenshot of the import results with MC29.
Logged

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 4271
Re: BD Folders import in library: installments missed (films)
« Reply #52 on: July 27, 2023, 02:50:23 pm »

Mattkhan to reimport their shares with MC31 and tell us the results
can confirm the reported problem

output of my script

Code: [Select]
pipenv run python bdmv_verify.py /home/matt/Downloads/files.txt 1.2.3.4 myuser mypass
NOT FOUND : /media/films/Back to the Future Part III/BDMV/index.bdmv
NOT FOUND : /media/films/Close Encounters of the Third Kind (Bonus)/BDMV/index.bdmv
NOT FOUND : /media/films/Die Hard 2/BDMV/index.bdmv
NOT FOUND : /media/films/Die Hard_ With a Vengeance/BDMV/index.bdmv
NOT FOUND : /media/films/Harry Potter and the Half-Blood Prince (Disc 2)/BDMV/index.bdmv
NOT FOUND : /media/films/Jurassic World_ Fallen Kingdom/BDMV/index.bdmv
NOT FOUND : /media/films/Mission_ Impossible - Ghost Protocol/BDMV/index.bdmv
NOT FOUND : /media/films/Mission_ Impossible II/BDMV/index.bdmv
NOT FOUND : /media/films/Mission_ Impossible III/BDMV/index.bdmv
NOT FOUND : /media/films/Scream 2022/BDMV/index.bdmv
NOT FOUND : /media/films/Sing Street/BDMV/index.bdmv
NOT FOUND : /media/films/Spy Kids 2/BDMV/index.bdmv
NOT FOUND : /media/films/Star Trek Beyond 3d/BDMV/index.bdmv
NOT FOUND : /media/films/TRON_ Legacy/BDMV/index.bdmv
NOT FOUND : /media/films/The Godfather_ Part II/BDMV/index.bdmv
NOT FOUND : /media/films/The Godfather_ Part III/BDMV/index.bdmv
NOT FOUND : /media/films/The Hunger Games_ Catching Fire/BDMV/index.bdmv
NOT FOUND : /media/films/The Hunger Games_ Mockingjay - Part 1/BDMV/index.bdmv
NOT FOUND : /media/films/The Smurfs 2/BDMV/index.bdmv
NOT FOUND : /media/films/This Is England '88/BDMV/index.bdmv
NOT FOUND : /media/films/This Is England '90/BDMV/index.bdmv
NOT FOUND : /media/films/This Is England 86/BDMV/index.bdmv
NOT FOUND : /media/films/Toy Story 4/BDMV/index.bdmv
Found 613 NOT 23

reported pattern (something directory name related) appears to dominate the gaps

percentage of missed folders slightly smaller in my case but that's highly likely to be an artifact of my content rather than anything fundamental
Logged

jespermart

  • Recent member
  • *
  • Posts: 18
Re: BD Folders import in library: installments missed (films)
« Reply #53 on: July 27, 2023, 02:52:05 pm »

Dismissive and patronising tone weakens yours.

Anyway, I’ve provided all the info I could, I suggest that we wait for:

Mattkhan to reimport their shares with MC31 and tell us the results
Jespermart to reimport with MC29 and see if it solves the issue, as it did for me.

Over and out.
I can confirm Manni's findings. Reimporting all my shares with MC29.0.91 solved all problems
Logged

jespermart

  • Recent member
  • *
  • Posts: 18
Re: BD Folders import in library: installments missed (films)
« Reply #54 on: July 27, 2023, 03:06:30 pm »

The reason why I haven't discovered the problem before is probably due to the fact, that I have always had a backup of my library lying around and every time I have reinstalled windows and jriver MC, I have simply restored my library from the backup copy. Only when I had to restore my library without black bar detection did I discover that I was missing 40 movies, mainly series in my 4K folder and about 20 movies in my BD folder.
Logged

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 4271
Re: BD Folders import in library: installments missed (films)
« Reply #55 on: July 27, 2023, 03:13:50 pm »

I reran import and no new items added

I then picked one of the missing folders at random and did a single folder import, it imported fine

there's clearly a bug in the bulk import somewhere but v hard to say where looking from the outside

I could speculate though :) e.g. it's clear that it chunks the load up into multiple tasks so some error in that chunking is feasible (and the no of missing files is close to the no of chunks which is highly likely to be a coincidence though could point towards a particularly simple bug)

Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 72536
  • Where did I put my teeth?
Re: BD Folders import in library: installments missed (films)
« Reply #56 on: July 27, 2023, 03:24:47 pm »

I can confirm Manni's findings. Reimporting all my shares with MC29.0.91 solved all problems
Thanks.
Logged

Hendrik

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 10969
Re: BD Folders import in library: installments missed (films)
« Reply #57 on: July 27, 2023, 05:26:07 pm »

can confirm the reported problem

How did you do the bulk import? Just pick the top level folder for import? Or setup auto-import?

Was this with the fix in .39? I could see import getting confused due to the inconsistency of the name.
If it wasn't with 39, can you re-run it?

If it persists, can you post a log of the original import on a previously empty library, and outline which ones ended up missing again (or at least a few)? It would take me some time to setup a bunch of ripped Blu-ray folders for testing. I had a set of maybe 20 and those went fine.

Logged
~ nevcairiel
~ Author of LAV Filters

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 4271
Re: BD Folders import in library: installments missed (films)
« Reply #58 on: July 28, 2023, 01:23:42 am »

I used auto import with a single drive/folder added (W:/) and ran it with 38, I'll retry with 39
Logged

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 4271
Re: BD Folders import in library: installments missed (films)
« Reply #59 on: July 28, 2023, 05:45:58 am »

results with .39

Code: [Select]
NOT FOUND : /media/films/Back to the Future Part III/BDMV/index.bdmv
NOT FOUND : /media/films/Close Encounters of the Third Kind (Bonus)/BDMV/index.bdmv
NOT FOUND : /media/films/Die Hard 2/BDMV/index.bdmv
NOT FOUND : /media/films/Die Hard_ With a Vengeance/BDMV/index.bdmv
NOT FOUND : /media/films/Harry Potter and the Half-Blood Prince (Disc 2)/BDMV/index.bdmv
NOT FOUND : /media/films/Jurassic World_ Fallen Kingdom/BDMV/index.bdmv
NOT FOUND : /media/films/Mission_ Impossible - Ghost Protocol/BDMV/index.bdmv
NOT FOUND : /media/films/Mission_ Impossible II/BDMV/index.bdmv
NOT FOUND : /media/films/Mission_ Impossible III/BDMV/index.bdmv
NOT FOUND : /media/films/Night at the Museum_ Battle of the Smithsonian/BDMV/index.bdmv
NOT FOUND : /media/films/Night at the Museum_ Secret of the Tomb/BDMV/index.bdmv
NOT FOUND : /media/films/Scream 2022/BDMV/index.bdmv
NOT FOUND : /media/films/Sing Street/BDMV/index.bdmv
NOT FOUND : /media/films/Spy Kids 2/BDMV/index.bdmv
NOT FOUND : /media/films/Star Trek Beyond 3d/BDMV/index.bdmv
NOT FOUND : /media/films/TRON_ Legacy/BDMV/index.bdmv
NOT FOUND : /media/films/The Godfather_ Part II/BDMV/index.bdmv
NOT FOUND : /media/films/The Godfather_ Part III/BDMV/index.bdmv
NOT FOUND : /media/films/The Hunger Games_ Catching Fire/BDMV/index.bdmv
NOT FOUND : /media/films/The Hunger Games_ Mockingjay - Part 1/BDMV/index.bdmv
NOT FOUND : /media/films/The Smurfs 2/BDMV/index.bdmv
NOT FOUND : /media/films/This Is England '88/BDMV/index.bdmv
NOT FOUND : /media/films/This Is England '90/BDMV/index.bdmv
NOT FOUND : /media/films/This Is England 86/BDMV/index.bdmv
NOT FOUND : /media/films/Toy Story 4/BDMV/index.bdmv
Found 611 NOT 25

added 2 new misses this time but otherwise the same, new misses are

Code: [Select]
NOT FOUND : /media/films/Night at the Museum_ Battle of the Smithsonian/BDMV/index.bdmv
NOT FOUND : /media/films/Night at the Museum_ Secret of the Tomb/BDMV/index.bdmv

log sent via email, lmk if anything else needed
Logged

Hendrik

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 10969
Re: BD Folders import in library: installments missed (films)
« Reply #60 on: July 28, 2023, 07:03:02 am »

Thanks, I figured it out, it should be fixed in the next build.
Logged
~ nevcairiel
~ Author of LAV Filters

Matt

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 42441
  • Shoes gone again!
Re: BD Folders import in library: installments missed (films)
« Reply #61 on: July 28, 2023, 10:05:41 am »

Logged
Matt Ashland, JRiver Media Center

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 72536
  • Where did I put my teeth?
Re: BD Folders import in library: installments missed (films)
« Reply #62 on: July 28, 2023, 02:13:38 pm »

Manni was right.  Here's the fix:

1. Fixed: Importing several Blu-ray structures with a common name could result in some being skipped.

Thanks to mattkhan for careful testing that put Hendrik on the right track to fix it.
Logged

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 4271
Re: BD Folders import in library: installments missed (films)
« Reply #63 on: July 28, 2023, 04:20:10 pm »

.40 is more broken, it certainly fixed the previous issue but introduced some new bug as I now have 190 missing BDs in this library (sent list separately)

also note that there is nothing named index.bdmv, they're all named index.bluray;1 . Is that intentional? I suspect yes but it's certainly a change which I guess could be a breaking one?

Logged

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 4271
Re: BD Folders import in library: installments missed (films)
« Reply #64 on: July 28, 2023, 04:30:57 pm »

ran import again on top of the partial import and now it has loaded everything, I didn't do anything different that time so not sure what happened. I'll try another clean import tomorrow to see if same thing recurs or if it imports everything in one go.
Logged

Hendrik

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 10969
Re: BD Folders import in library: installments missed (films)
« Reply #65 on: July 28, 2023, 05:26:41 pm »

The change was very simple and isolated, finding it was the real problem. Once there, all the behavior made perfect sense. So I don't expect any side-effects from it. Essentially, when it was grouping up things for a single Blu-ray aggregate (as part of the changes to improve this in MC30), it was checking for things to start with W:\Movie, instead of W:\Movie\, hence "movie series" being affected, as they shared a common path fragment. This change alone should not have any other impact.

The naming of index.bluray is intentional and how Blu-ray structures have historically always been named - except for a brief period where a bug with the extended video analysis overwrote the name to index.bdmv.
Logged
~ nevcairiel
~ Author of LAV Filters

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 4271
Re: BD Folders import in library: installments missed (films)
« Reply #66 on: July 29, 2023, 03:57:51 am »

retried the import from fresh, completed normally this time and did load everything with no gap
Logged

Manni

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 509
Re: BD Folders import in library: installments missed (films)
« Reply #67 on: July 29, 2023, 08:05:18 am »

Thanks to Matttkhan and Jespermart for confirming my findings.
Thanks to Hendrik for fixing this bug.

I can confirm that the bug is fixed here. All 252 titles are imported right away with MC31 build 40 and are visible with the default view, as was the case with MC28.
Logged
Pages: 1 [2]   Go Up