INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1]   Go Down

Author Topic: Importing a very large library of music  (Read 1141 times)

tg30

  • Member
  • *
  • Posts: 4
Importing a very large library of music
« on: February 21, 2022, 12:38:42 pm »

Newby to JRiver.

My music library is all housed on an external NAS, I have a 10G network (dedicated) between the Windows and the NAS. The library is about 2.5 million files that I have collected over the past 20 years. What is the best method of importing this many files ? Is there a method of doing batch imports ? Or just configure auto import and let it sit for a few days ?
Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 72407
  • Where did I put my teeth?
Re: Importing a very large library of music
« Reply #1 on: February 21, 2022, 02:48:19 pm »

Set up auto import to watch the folders you want on the NAS and then import.
Logged

HPBEME

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 1094
  • Goodnight and Good Luck
Re: Importing a very large library of music
« Reply #2 on: February 22, 2022, 06:10:19 pm »

yeah... what Jim said.

But I just have to ask... 2.5 million tracks?  WOW.

That is, on average, 125000 tracks added per year - which is 340+ tracks added per day, everyday, for 20 straight years.  That does not even seem humanly possible.  Man, I thought I had a decent sized collection at 23,000 tracks, but yours is over 100X (!) bigger.  I am most definitely impressed... and jealous.
Logged

tg30

  • Member
  • *
  • Posts: 4
Re: Importing a very large library of music
« Reply #3 on: February 23, 2022, 09:28:09 am »

I started with thousands of CD's
over the years I have collected some interesting (mostly) uncommon music.
Example I have a massive collection of Italian Disco, PreWar Blues, and the like.
I use custom scripts with beets to tag as much as possible.
Logged

BryanC

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 2661
Re: Importing a very large library of music
« Reply #4 on: February 24, 2022, 07:16:35 am »

Do you have any experience with beets' LastGenre plugin or other genre tagging plugins in beets? I've attempted to do this with Musicbrainz, but its album matching is awful IME. I was thinking of using beets + discogs plugin for matching and LastGenre for genre tagging.
Logged

tg30

  • Member
  • *
  • Posts: 4
Re: Importing a very large library of music
« Reply #5 on: February 24, 2022, 07:25:58 am »

Yes I do use it extensively.
Logged

woollies66

  • Recent member
  • *
  • Posts: 35
Re: Importing a very large library of music
« Reply #6 on: February 28, 2022, 08:21:58 am »

Hi

I recently had to re-import my various libraries

I have 5 nas's

2 music (40 tb)
1 uhd Movies (20 tb)
1 Tv Shows (20 tb)
1 HD Movies (20 tb)

the 2 music nas's have 300k tracks and it took 4 days to re-import. I have a similar network setup as yourself, the constraint I had was the NAS's performance in terms of writes on the disk controllers and disks within the nas's (4 x 8tb disks)

The music nas' file formats are mainly Flac with some SACD (about 5%)

I'd be interested in how long it takes you to import your music library.

Regards

Woollies66

Logged

zybex

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 2590
Re: Importing a very large library of music
« Reply #7 on: March 01, 2022, 03:40:26 am »

Sometimes MC crashes when importing a corrupt file. While this has been addressed multiple times and is now much less common, it may still happen to you since you have such a huge collection. If you see MC crashing (it just closes unexpectedly) you can look at the log file to see which was the track that MC was importing and caused the crash.

If this becomes a problem you may want to import your collection in sections (of subfolder tree at a time) instead of having to restart the whole thing each time it crashes. Anyway, just try to import it all in one go at first, maybe this won't be needed.
Logged
Pages: [1]   Go Up