INTERACT FORUM

More => Old Versions => JRiver Media Center 28 for Windows => Topic started by: tg30 on February 21, 2022, 12:38:42 pm

Title: Importing a very large library of music
Post by: tg30 on February 21, 2022, 12:38:42 pm: Newby to JRiver.

My music library is all housed on an external NAS, I have a 10G network (dedicated) between the Windows and the NAS. The library is about 2.5 million files that I have collected over the past 20 years. What is the best method of importing this many files ? Is there a method of doing batch imports ? Or just configure auto import and let it sit for a few days ?
Title: Re: Importing a very large library of music
Post by: JimH on February 21, 2022, 02:48:19 pm: Set up auto import to watch the folders you want on the NAS and then import.
Title: Re: Importing a very large library of music
Post by: HPBEME on February 22, 2022, 06:10:19 pm: yeah... what Jim said.

But I just have to ask... 2.5 million tracks? WOW.

That is, on average, 125000 tracks added per year - which is 340+ tracks added per day, everyday, for 20 straight years. That does not even seem humanly possible. Man, I thought I had a decent sized collection at 23,000 tracks, but yours is over 100X (!) bigger. I am most definitely impressed... and jealous.
Title: Re: Importing a very large library of music
Post by: tg30 on February 23, 2022, 09:28:09 am: I started with thousands of CD's
over the years I have collected some interesting (mostly) uncommon music.
Example I have a massive collection of Italian Disco, PreWar Blues, and the like.
I use custom scripts with beets to tag as much as possible.
Title: Re: Importing a very large library of music
Post by: BryanC on February 24, 2022, 07:16:35 am: Do you have any experience with beets' LastGenre plugin or other genre tagging plugins in beets? I've attempted to do this with Musicbrainz, but its album matching is awful IME. I was thinking of using beets + discogs plugin for matching and LastGenre for genre tagging.
Title: Re: Importing a very large library of music
Post by: tg30 on February 24, 2022, 07:25:58 am: Yes I do use it extensively.
Title: Re: Importing a very large library of music
Post by: woollies66 on February 28, 2022, 08:21:58 am: Hi

I recently had to re-import my various libraries

I have 5 nas's

2 music (40 tb)
1 uhd Movies (20 tb)
1 Tv Shows (20 tb)
1 HD Movies (20 tb)

the 2 music nas's have 300k tracks and it took 4 days to re-import. I have a similar network setup as yourself, the constraint I had was the NAS's performance in terms of writes on the disk controllers and disks within the nas's (4 x 8tb disks)

The music nas' file formats are mainly Flac with some SACD (about 5%)

I'd be interested in how long it takes you to import your music library.

Regards

Woollies66
Title: Re: Importing a very large library of music
Post by: zybex on March 01, 2022, 03:40:26 am: Sometimes MC crashes when importing a corrupt file. While this has been addressed multiple times and is now much less common, it may still happen to you since you have such a huge collection. If you see MC crashing (it just closes unexpectedly) you can look at the log file to see which was the track that MC was importing and caused the crash.

If this becomes a problem you may want to import your collection in sections (of subfolder tree at a time) instead of having to restart the whole thing each time it crashes. Anyway, just try to import it all in one go at first, maybe this won't be needed.