Topic: Incomplete importation into the library (Read 4044 times)

mobyfrag · « **on:** January 23, 2008, 01:29:43 pm »

Hello everyone,

Since many versions (up to the 410) of JR MC 12, when I want to import folders in the library, that functions only partially.
In practice, I have a folder “Music” on my external hard drive (different from the “My Music” Folder). This one contains 1 sub-folder by artist. I have approximately 750 artists.
The problem is that only one part of the 750 folders are really imported. I must manually “Import into Library” the missing sub-folders.
I specify that this folder 'Music' (and others) is in the "Auto-import folders" list.
Can you help me, please.

Thanks

JimH · « **Reply #1 on:** January 23, 2008, 04:01:39 pm »

If you've previously removed a folder or its files from MC, it won't re-import them unless you tell it to (it's an option in the Import dialog).

mlagase · « **Reply #2 on:** January 23, 2008, 10:10:38 pm »

I reported this the other day in another thread, but did not get very far with it. Performing the manual import appears to grab everything whereas Auto-Import misses some things.

I even went as far as removing my entire library and recreating it to no avail. I ended up manually importing the files which worked for me. I guess I will have to monthly manual imports to ensure that all files are picked up out of my music collection.

Mike

Jinster · « **Reply #3 on:** January 23, 2008, 11:36:34 pm »

Hmm... after reading this post. I decided to manually import my master music directory by right clicking the folder in explorer and choose manual import under MC shell extension.

Found new 3 albums of MP3s that weren't picked up with auto import all these years/months.....

I always rip music using a 3rd party program, and then copy the directory into my master MP3 directory which MC auto imports. There is no removal from database here for these directories, ever...

modelmaker · « **Reply #4 on:** January 24, 2008, 04:27:07 am »

Why use a 3rd party ripper when MC is the best ripper and organizer on the planet? ?

mobyfrag · « **Reply #5 on:** January 24, 2008, 09:04:08 am »

Quote from: JimH on January 23, 2008, 04:01:39 pm

If you've previously removed a folder or its files from MC, it won't re-import them unless you tell it to (it's an option in the Import dialog).

Hmm, I had format my PC before to reinstall all (Windows Vista, JR MC and new library). There was thus no file excluded. : (
There was thus no file excluded.

Quote from: mlagase on January 23, 2008, 10:10:38 pm

I even went as far as removing my entire library and recreating it to no avail. I ended up manually importing the files which worked for me. I guess I will have to monthly manual imports to ensure that all files are picked up out of my music collection.

Mike

yes, me too $:-\$

Jinster · « **Reply #6 on:** January 24, 2008, 09:46:18 pm »

Modelmaker: My HTPC sits in the lounge room. It's not very practical or comfortable for me to sit here and rip MP3s. So I generally rip them on my laptop first, especially when on the move, and then transfer everything when I get a chance.

mobyfrag · « **Reply #7 on:** January 30, 2008, 11:26:58 am »

Does anybody other have this problem?

Could there be an option which I badly configured? $:-\$

Thank you.

JimH · « **Reply #8 on:** January 30, 2008, 11:43:19 am »

All the options for import are there under Advanced.

Previously imported files you've deleted can be re-imported by setting the option.

Small files?

hit_ny · « **Reply #9 on:** January 30, 2008, 12:19:40 pm »

Quote from: Jinster on January 23, 2008, 11:36:34 pm

Found new 3 albums of MP3s that weren't picked up with auto import all these years/months.....

This is rather curious and should have been done with the auto-import, anything unique about these three you can see ?

trott · « **Reply #10 on:** February 01, 2008, 03:09:30 am »

I have started to notice problems too after comparing the total number of audio files in MC and iTunes. I have several files which do not import. The rest of the album gets imported; it's just that several files are missing. I tried an auto-import with the option 'do not imported previously removed files' unticked. Even a manual import will not import them, even though they exist in the filesystem and play just fine.
This happens with both mp3 and m4a files.

Here's a sample of the import log:

Code: [Select]

0021607: 6984: Import: CSynchronizeDatabase::Import: Start
0021607: 6984: Import: CSynchronizeDatabase::Import: Stopping folder watching
0021622: 6984: Import: CSynchronizeDatabase::Import: Stopping other processing
0021622: 6984: Import: CSynchronizeDatabase::Import: Creating processor
0021622: 6984: Import: CSynchronizeDatabase::Import: Process
0021622: 6984: Import: CSynchronizeDatabaseProcess::Process: Start
0021622: 6984: Import: CSynchronizeDatabaseProcess::Process: Creating progress
0021638: 6984: Reader: CLocalReader::OpenInternal: Opening: C:\Program Files\J River\Media Center 12\Data\Default Art\ActionWindowNavigation.png
0021653: 6984: Reader: CLocalReader::Close: Closing: C:\Program Files\J River\Media Center 12\Data\Default Art\ActionWindowNavigation.png
0021669: 6984: General: CMainUIWnd::Resize: Start
0021685: 6984: Reader: CLocalReader::OpenInternal: Opening: C:\Program Files\J River\Media Center 12\MegaSkins\Noire\ActionWindow_Restore.png
0021700: 6984: Reader: CLocalReader::Close: Closing: C:\Program Files\J River\Media Center 12\MegaSkins\Noire\ActionWindow_Restore.png
0021700: 6984: General: CMainUIWnd::Resize: Finish (31 ms)
0021716: 6984: Import: CSynchronizeDatabaseProcess::Process: Notifying UI
0021716: 6984: Import: CSynchronizeDatabaseProcess::Process: Starting thread
0021716: 6984: Import: CSynchronizeDatabaseProcess::Process: Finish (94 ms)
0021716: 6984: Import: CSynchronizeDatabase::Import: Finish (109 ms)
0021716: 4256: Import: Process: Starting import (JRiver Media Center 12.0.410)
0021716: 4256: Import: GetNewFiles: Start
0022012: 4256: Import: GetNewFiles: Finish (296 ms)
0022012: 4256: Import: Process: Finish (296 ms)
0022028: 6984: General: CMainUIWnd::Resize: Start
0022043: 6984: General: CMainUIWnd::Resize: Finish (15 ms)
0022043: 6984: Import: Finish: Updating view schemes
0022075: 6984: Import: Finish: Showing summary

Additionally, here are the file details:

Code: [Select]

01/01/2008  11:35         7.754.692 1. Gerry Raferty - Baker Street (1977).m4a
27/01/2007  11:08         5.721.112 2. Kate Bush - Wuthering Heights (1978).m4a
31/12/2007  19:15         4.003.329 3. Sparks - This town ain't big enough for the both of us (1974).m4a
27/01/2007  11:08         5.895.826 4. ELO - Roll over Beethoven (1972).m4a
27/01/2007  11:08         4.871.812 6. Roxy Music - Love is the drug (1976).m4a
31/12/2007  19:15         4.123.607 7. Bryan Ferry - The price of love (1976).m4a
31/12/2007  19:15         4.647.268 8. Steve Harley & Cockney Rebel - Make me smile (1975).m4a
31/12/2007  19:15         5.226.266 9. Don McLean - American Pie (1971).m4a
31/12/2007  19:15         5.866.658 10. Gary Brooker - No more fear of flying (1979).m4a
01/01/2008  11:35         4.653.422 11. The Band - Time to kill (1970).m4a
01/01/2008  11:35         6.051.873 12. Eric Carmen - All by myself (1976).m4a
01/01/2008  11:35         7.370.256 14. Joe Walsh - Rocky mountain way (1973).m4a
27/01/2007  11:08         4.334.724 15. Herman Brood & His Wild romance - Saturday Night (1978).m4a
01/01/2008  12:05        12.816.976 16. Ten Years After - I'm going home (1975).m4a
27/01/2007  11:08         5.086.167 17. Genesis - Follow yoy follow me (1978).m4a
31/12/2007  19:15         4.902.498 5. Robert Palmer - Best of both worlds (1978).m4a
01/01/2008  11:34         5.922.878 13. Jethro Tull - Locomotive breath (1972).m4a
01/02/2008  10:07               144 dir.txt
              18 File(s)     99.249.508 bytes
               2 Dir(s)   4.854.464.512 bytes free

On this specific album, the third file won't import.

Alex B · « **Reply #11 on:** February 01, 2008, 03:31:24 am »

Quote

3. Sparks - This town ain't big enough for the both of us (1974).m4a

If you use QuickTime decoding this filename is too long. It contains 68 characters (including spaces).

Quote

15. Herman Brood & His Wild romance - Saturday Night (1978).m4a

This name contains 63 characters, which is the maximum QT can handle.

DirectShow decoding would not have this problem and it would allow you to use DSP, Volume Leveling etc.

Here is more info about m4a and DirectShow decoding:
http://wiki.jrmediacenter.com/index.php/MP4_and_M4A_File_Support
and here:
http://wiki.jrmediacenter.com/index.php/DirectShow_Playback_Guide

Quote

This happens with both mp3 and m4a files.

Do you have a log of an unsuccesful MP3 import attempt?

trott · « **Reply #12 on:** February 01, 2008, 03:37:14 am »

I am using directshow playback...I also don't think it's a filename length issue; the 15th track imported without problems.

Alex B · « **Reply #13 on:** February 01, 2008, 03:42:30 am »

The track #15 has a shorter filename:

Quote from: Alex B on February 01, 2008, 03:31:24 am

Quote
15. Herman Brood & His Wild romance - Saturday Night (1978).m4a

This name contains 63 characters, which is the maximum QT can handle.

Maybe it is just a coincidence or maybe the DS decoding system fails just when you are importing and MC reverts to QT.

JimH · « **Reply #14 on:** February 01, 2008, 08:04:30 am »

64 characters is a QT limit, not an MC limit.

We had a problem about a month ago where someone was setting a filetype for DirectShow playback but MC always played using QT. I don't remember the solution. It may have been changing the filter. You could try a search.

Alex B · « **Reply #15 on:** February 01, 2008, 08:17:42 am »

Quote from: JimH on February 01, 2008, 08:04:30 am

64 characters is a QT limit, not an MC limit.

-- as I said (63 is the maximum that still works, 64 is one too many.)

For some reason trott didn't say if he tried shortening the file name. Maybe he was away from the PC.

hit_ny · « **Reply #16 on:** February 01, 2008, 08:24:23 am »

What a strange limit for QT to have when the filesystem is capable of much more...almost reminds me of Joliet on CD-R.

..we are in 2008

trott · « **Reply #17 on:** February 02, 2008, 02:22:08 am »

I'm using directshow so don't think it's a QT issue. but after closer inspection, all the missing files do seem to be m4a files after all. Here are some more which won't import:
M:\music\koen\lossless rips\aac\Bruce Springsteen\18 Tracks\07.I Wanna Be With You.m4a
M:\music\koen\lossless rips\aac\Beatles, the\Anthology 3 (Disc 1)\02.Happiness Is A Warm Gun.m4a
M:\music\koen\lossless rips\aac\Beatles, the\Anthology 3 (Disc 2)\21.Let It Be.m4a

And here is an album on which tracks 1, 2, 10,11,12,13 and 14 won't import.

Quote

M:\music\koen\lossless rips\aac\Breeders, The\Last Splash>dir /b
1. New Year.m4a
10. Divine Hammer.m4a
11. S.O.S..m4a
12. Hag.m4a
13. Saints.m4a
14. Drivin' On.m4a
15. Roi (Reprise).m4a
2. Cannonball.m4a
3. Invisible Man.m4a
4. No Aloha.m4a
5. Roi.m4a
6. Do You Love Me Now_.m4a
8. I Just Wanna Get Along.m4a
9. Mad Lucas.m4a
folder.jpg
7. Flipside.m4a

All these files play ok in another player.

Anyway, I tried renaming the file (sparks - this town is big enough for the both of us) to a shorter name and it imported. Then, I tried renaming it to a longer filename and it also imported!

So, somehow it seems that MC thinks it already has this file in its library (even though it does not). This is really annoying, since I can trace the missing files with the 'incomplete albums' function but what about files which were not in an album?

[Edit]
To make this even more strange, after renaming the file once again to its original name (which wouldn't import) it does import correctly.

mobyfrag · « **Reply #18 on:** February 05, 2008, 01:11:13 am »

Quote from: JimH on January 30, 2008, 11:43:19 am

Small files?

Not: normal file size for music files. The various formats are OGG, MP3, FLAC, APE and WV. The sizes vary from 1 MB to 25 MB. $:-\$

mobyfrag · « **Reply #19 on:** March 21, 2008, 06:53:54 pm »

I found!!

After an in-depth study, I discovered that the folders (with music albums), which are not imported, contain hidden files of the type:
AlbumArt_{3F943725-949F-4F75-B270-778D18037627}_Large.jpg
AlbumArt_{3F943725-949F-4F75-B270-778D18037627}_Small.jpg
AlbumArtSmall.jpg
The format isn't determining: MP3, OGG or WMA.

I hope that will be able to help you. It is a big problem here!
Thank you.

mobyfrag · « **Reply #20 on:** March 25, 2008, 06:59:09 am »

Is it a stupid idea?

Isn't this interesting?

leezer3 · « **Reply #21 on:** March 25, 2008, 08:38:12 am »

Doubt thats anything but a red herring.
Those are only Windows Media Player album art files (Vista for that matter tends to fish them up automatically without asking), and shouldn't affect anything.)

Upload them somewhere anyway & someone can have a quick poke.

Cheers

-Leezer-

trott · « **Reply #22 on:** April 13, 2008, 08:06:27 am »

I think this is a library issue. I just tried creating a new library and tried importing an album which had missing tracks. All files imported OK. Actually, what frustrates me is that I have no clue what happened. The import process does not show any errors. The files may have been there in the past but somehow they're missing. Then again, it's possible that the files have always failed to import.
I think an option 'check library for consistency or errors' should exist...

[edit]In fact, when looking at the field (filename).jmd file with a hex editor, I have confirmed that the missing files are listed there. So, keeping in account I tried the option to re-import files previously deleted from the library, why can't I see them?

I was using MC to fully manage my digital media files so I need to be absolutely certain that all files are actually correctly imported OR I need to be notified by MC if there's a problem.

fitbrit · « **Reply #23 on:** April 14, 2008, 02:02:48 am »

Quote from: Jinster on January 24, 2008, 09:46:18 pm

Modelmaker: My HTPC sits in the lounge room. It's not very practical or comfortable for me to sit here and rip MP3s. So I generally rip them on my laptop first, especially when on the move, and then transfer everything when I get a chance.

A simple solution would be to install MC on your laptop as well. Jim has said that we can install MC on all the PCs we use.

INTERACT FORUM

Author Topic: Incomplete importation into the library (Read 4044 times)