Topic: MC 22 crashed after import of 146,000 files (Read 4933 times)

europaroger · « **on:** February 25, 2017, 05:40:20 am »

I have recently installed MC on 2 Windows machines.
Last week I imported 182,000 files ok on both machines . Today I deleted many files from within windows, went into MC, clear library, set fields to default, library manager , delete library . I then tried to import about 170,000 files but MC on both machines crashed at the same file import about file number 146,000. Have I reached a software limit or can you advise. Stange how it was able to import a larger number last week but now cannot.
Any assistance is appreciated.
Roger from Brisbane , Australia.

CountryBumkin · « **Reply #1 on:** February 25, 2017, 06:22:42 am »

There is no file limit. Something just went wrong with computer or program. Try again (maybe do a smaller number of files in each import batch).

Spike1000 · « **Reply #2 on:** February 26, 2017, 04:14:00 am »

You may have a corrupt file.

Spike

aviateur · « **Reply #3 on:** February 26, 2017, 01:11:52 pm »

... or the HD may be failing. I had a similar problem several months ago where several large (90,000+) import attempts stopped prematurely. I replaced the HD and importing resumed normally.

rsg · « **Reply #4 on:** February 27, 2017, 08:42:23 pm »

Wow! Where do you store all those files? What format do you use, and how much space does it take up? I am assuming they are music files, but I could be wrong. I am using ALAC (used to be with ITunes); 30,000 files fills up almost 1 TB. I have a 2TB drive and will probably stop collecting when I reach 75,000 songs (2 TB maybe)...yeah, as if...

europaroger · « **Reply #5 on:** February 28, 2017, 01:32:11 am »

I traded a box of beer for a friend's lifetime collection of mp3's approx. 2 TB.
I have 26 folders A,B,C -> Z for artist names. Bob Dylan , Bob Marley , Billy Brag go in B etc. I import one letter at a time. Biggest folder has 17,000 files. If any larger number MC seems to crash. So far I have done A,B,C,D,E.
I store "T-ReX" in "T" folder, but have a folder called "The" for "The Beatles" etc. MC has a "clean artist names" function which will change the name to "Beatles The" but I have not tried it yet.

CountryBumkin suggested importing in smaller batches and seems ok so far but will advise maybe next two weeks.

JimH · « **Reply #6 on:** February 28, 2017, 06:37:03 am »

Are the files on a local drive? Or a network or USB drive.

~OHM~ · « **Reply #7 on:** February 28, 2017, 09:16:32 am »

Quote from: europaroger on February 28, 2017, 01:32:11 am

I traded a box of beer for a friend's lifetime collection of mp3's approx. 2 TB.
I have 26 folders A,B,C -> Z for artist names. Bob Dylan , Bob Marley , Billy Brag go in B etc. I import one letter at a time. Biggest folder has 17,000 files. If any larger number MC seems to crash. So far I have done A,B,C,D,E.
I store "T-ReX" in "T" folder, but have a folder called "The" for "The Beatles" etc. MC has a "clean artist names" function which will change the name to "Beatles The" but I have not tried it yet.

CountryBumkin suggested importing in smaller batches and seems ok so far but will advise maybe next two weeks.

this is about your file organization: eventually your not gonna be happy with your file system. I suggest to you to have 1 main folder- inside of that folder would be folders for each artist. " The Beatles " inside of this folder would be the corresponding cd's 1969 Abbey Road, 1970 Let It Be

yes I am well aware of MC strong organization. I'm talking about how it is presented in windows. I have a huge Library and it took me many months to change it. your library will grow! now is the time to get it under control from a windows point of view. I insert the year of the cd first because then it organizes by year of release. Good Luck on what ever you choose..Once again this is for windows organization!

europaroger · « **Reply #8 on:** March 04, 2017, 10:42:40 pm »

I purchased a windows license about 13 days ago and have tried on 2 different machines with new hard drives to import my library. When it gets near 3/4 of the way MC crashes and does not recover. I have had some assistance from the JRiver forum but MC still crashes. I have since loaded my library into foobar with no problems.

All JRiver software has been removed.
Please see attached files for PayPal reversal.
Licence code is ----------------------------------- (edit by moderator, don't post your license code in public)

***********************************
Roger Roberts

Awesome Donkey · « **Reply #9 on:** March 05, 2017, 05:43:47 am »

Enable logging, reproduce a crash, and post the log here.

http://wiki.jriver.com/index.php/Logging

Chances are you have a bad file or files which is causing the crash.

CountryBumkin · « **Reply #10 on:** March 05, 2017, 05:47:02 am »

Showing your proof of purchase and license doesn't help solve the problem - and is not really a good idea to do so on a public forum.

There is a 99% chance that you have a corrupt file in the batch. When MC gets to that file, it hangs.
We have all seen this happen a thousand times - and we asked JRiver to provide better logging so we can find this bad file.

The only thing you can do is import in small batches to find the batch where the "hang occurs" then divide that batch into smaller batches to eventually figure out which file is causing the problem. When you find the bad file send it to JRiver dev team so they can investigate and maybe improve MC.

You can/should post your log file - maybe someone can read the log and get a clue where the hang is. I would recommend you clear the log after every successful import (to keep the log file small). Go to Help>Logging. There is a Reset Log button there. Also be sure that Logging is turned on (checkmark in box). Then after a hang, right after you restart MC go to Logging and click on the "Report Problem" button. Finally attach that Log to your post using the "Attachments and other options" link at the bottom of the forum page.

JimH · « **Reply #11 on:** March 05, 2017, 10:53:24 am »

Try importing a single file type at a time. Edit auto import settings to specify the filetype.

It's likely you have a bad file. If you can find it, we'd like to see it.

europaroger · « **Reply #12 on:** March 06, 2017, 11:57:18 pm »

I have a new hard drive with 26 folders A,B,C etc for Abba, Billy Brag, Creedance etc.

On machine 1 , I started importing each folder individually starting from A,B,C,D... and waiting for each one to finish before going to the next.
When it got to about S MC crashed.

On machine 2 I started importing each folder individually starting from Z,Y,X,W and waiting for each one to finish before going to the next.
When it got to about G MC crashed.

So the above demonstrates the imported files themselves seem to be ok. After each folder import there is a list of "failed to import"
and these have been deleted from the hard drive.

I could turn on logging and repost the results but I have already spent many , many hours importing and checking the results.
Is seems MC reaches a limit of its file handing capacity and just dies with no warning. I have already scanned the new hard drive at my workplace ( Australian University) and found no viruses. Foobar has been able to complete the import ( or skip any bad files) but MC crashes and continues to crash until I clear the entre library.

JimH · « **Reply #13 on:** March 07, 2017, 06:10:53 am »

Are you running antivirus software?

Are the files local or network?

What is the drive?

Anything else unusual?

It isn't the 146,000 files. We have users with more than 1,000,000 files.

Foobar doesn't do image files or video files, so it's not a good test.

Awesome Donkey · « **Reply #14 on:** March 07, 2017, 06:14:07 am »

Quote from: europaroger on March 06, 2017, 11:57:18 pm

I could turn on logging and repost the results but I have already spent many , many hours importing and checking the results.
Is seems MC reaches a limit of its file handing capacity and just dies with no warning. I have already scanned the new hard drive at my workplace ( Australian University) and found no viruses. Foobar has been able to complete the import ( or skip any bad files) but MC crashes and continues to crash until I clear the entre library.

Again, there's no file limit. Chances are very good that you have a bad file or files, which is causing MC to crash. Enabling logging, reproducing a crash and posting the log here allows the JRiver developers to figure out which file(s) are causing the crash. Once said file(s) are identified, the developers will probably want a copy of the file(s) so they can address the issue on their side. You can then also move the bad file(s) to a different directory so they won't crash MC and importing can complete without issue.

bob · « **Reply #15 on:** March 07, 2017, 11:06:04 am »

A few questions:

I assume the import was local? Files not on a network drive and run on the local machine (not a server).

What were you doing while the files were importing? Just hanging out or browsing them as they imported?

Do you have a log file?

europaroger · « **Reply #16 on:** March 07, 2017, 10:42:12 pm »

Hard drive is external USB with it's own power source 2.8 TByte .
No other aps are running in back ground.
I have re-downloaded and re-installed MC. Two weeks ago it was ver 22.0.59 and now 22.0.77 and have enabled logging.
Auto import is configured to put cover art in a separate folder and not auto add into mp3 tag.
Folder A has been imported without errors and logging folder shows sys info and nil errors.
Will continue with B,C,D etc during the week.

During each folder import it rebuilds the thumbnails. Should I turn off "rebuild thumbnails" during auto import
and do it manually after the last folder ?

Thanks for your help. I really hope I can get this working.

bob · « **Reply #17 on:** March 08, 2017, 10:46:32 am »

Quote from: europaroger on March 07, 2017, 10:42:12 pm

Hard drive is external USB with it's own power source 2.8 TByte .
No other aps are running in back ground.
I have re-downloaded and re-installed MC. Two weeks ago it was ver 22.0.59 and now 22.0.77 and have enabled logging.
Auto import is configured to put cover art in a separate folder and not auto add into mp3 tag.
Folder A has been imported without errors and logging folder shows sys info and nil errors.
Will continue with B,C,D etc during the week.

During each folder import it rebuilds the thumbnails. Should I turn off "rebuild thumbnails" during auto import
and do it manually after the last folder ?

Thanks for your help. I really hope I can get this working.

We were looking at the thumbnail processing yesterday, it's really complex.
It would be interesting if you did the import with it turned off then build them afterwards.

AndreaT · « **Reply #18 on:** March 08, 2017, 01:13:58 pm »

Hello, it looks more or less as my problem I posted the past week.
MC 22 crashes during initial library import. I have 5 HDs with tons of files.
In my case, MC 22 crashes usually around 80k files imported.
I have the MC debug zip of 31 MB to provide to developer but I don't know how to post such a big file.
Kindly let me know how to contribute to fix this bug.
Regards
Andrea

europaroger · « **Reply #19 on:** March 08, 2017, 05:38:15 pm »

My first complete import of all folders finally completed last night.
I have 26 Windows folders A,B,C etc for Abba, Billy Brag, Creedance and each has about 14000 files.

F:\music\a
F:\music\b
F:\music\c
etc

F:\coverart\

Tools,options,file location, one folder for music, movies, cover art, do not include cover art in mp3 file

I did import,config auto, select folder A, tick ignore, ok, get cover art, untick rebuild thumbs, tick fix broken links

After import of A folder you should see details icon to see import results.
Scroll down to bottom to see failed imports. Delete these files or move elsewhere.
Next import folder B but remove folder A as it has already been imported.

When you have finished with Z folder go to tools options, tree , thumbnails , rebuild ( may take a long time).

Last week it was MC ver 22.0.59 and now 22.0.77 seems more stable.

Above seems to work for me.

JohnT · « **Reply #20 on:** March 09, 2017, 09:20:11 am »

Quote from: AndreaT on March 08, 2017, 01:13:58 pm

Hello, it looks more or less as my problem I posted the past week.
MC 22 crashes during initial library import. I have 5 HDs with tons of files.
In my case, MC 22 crashes usually around 80k files imported.
I have the MC debug zip of 31 MB to provide to developer but I don't know how to post such a big file.
Kindly let me know how to contribute to fix this bug.
Regards
Andrea

Do you use any file sharing service that you could provide a public link to? Dropbox, Google Drive, etc.

AndreaT · « **Reply #21 on:** March 09, 2017, 02:05:03 pm »

No. Sorry. Regards.

INTERACT FORUM

Author Topic: MC 22 crashed after import of 146,000 files (Read 4933 times)