INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1]   Go Down

Author Topic: Handheld CACHE questions  (Read 3001 times)

slipknot

  • Galactic Citizen
  • ****
  • Posts: 255
Handheld CACHE questions
« on: October 20, 2006, 08:31:17 pm »

I now have my ipod fully synched with MC12 and I'm using the new caching feature with a size limit of 100gig.

Question: When MC12 finds the cache has grown too large (based on the user size limit setting), how does it select the files to delete from the cache?  Oldest?  Files where the track no longer exists in the MC library?


Tonight I renamed an album and re-synched.  After the synch I had CACHED copies of the track under the old name and under the new name.  This seems to mean that when tracks are removed from the MC12 library that they are not removed from the CACHE.

These obsolete files have no value anymore since the the source track no longer exists in the MC12 library.  They can never be synched, they are zombie files taking up space.

Now if MC12 would choose to delete these zombie files first when the cache size is reached, no problem here.

I just don't want zombie files to push me to my cache limit and then have MC start to delete valid cache file with these zombies taking up space that will never be used.
Logged

slipknot

  • Galactic Citizen
  • ****
  • Posts: 255
Re: Handheld CACHE questions
« Reply #1 on: October 22, 2006, 07:43:12 pm »

Jim?  Matt?
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: Handheld CACHE questions
« Reply #2 on: October 23, 2006, 09:26:43 am »

A few things...

The clear cache button is your friend.

I go through and whack all the files that do not exist.  But note that if you change settings I do not catch that.  So if you're encoding to wma now I do not delete the mp3s.  But if you delete fred.ape I'll get rid of fred.*.

I delete based on modified date.  On each upload I change the update the modified date of the file.  So if you keep tranfering a given song it should not be deleted.  This will also take care of the zombie files.  As they will eventually fall out of the cache.

If a given transfer goes above the size of the cache I do not prune the cache until after the transfer.  (So if you move 150G of files I will not prune the cache until after the move.)

Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: Handheld CACHE questions
« Reply #3 on: October 23, 2006, 09:48:36 am »

One other thing.  Since I put the rule stuff into place I have changed the directory it goes to at least twice.  Once to put it under a jrhhcache directory under the specified directory and another time to remove the [HHDevice] rule.  (Which is now accomplished via a check box.)
Logged

slipknot

  • Galactic Citizen
  • ****
  • Posts: 255
Re: Handheld CACHE questions
« Reply #4 on: October 23, 2006, 08:24:31 pm »

A few things...

The clear cache button is your friend.

Why?  It takes 24 hours to convert all my ape files to mp3 for my ipod.  Clearing the cache defeats the purpose of the cache.

Quote
I go through and whack all the files that do not exist.

Manually?  How do you keep track of so many files in your head?

Quote
  But note that if you change settings I do not catch that.  So if you're encoding to wma now I do not delete the mp3s.  But if you delete fred.ape I'll get rid of fred.*.

Wouldn't rm fred.* get rid of any type file?

But like I described.  I renamed an album, so the tags changed.

After synching, I now have a dir in my cache for both the old album name AND the new album name and each dir has mp3 files for each track.  The old album cached files have no value, ever again.  So why are they still around?

Try it, do as I describe and see the result.
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: Handheld CACHE questions
« Reply #5 on: October 24, 2006, 10:50:37 am »

Why?  It takes 24 hours to convert all my ape files to mp3 for my ipod.  Clearing the cache defeats the purpose of the cache.

It is a cache.  Caches can be invalidated at any time.  If you do not wish to wait for files to fall off the bottom of the cache then you should clear the cache or manually delete files.  This is not a tightly coupled feature.  It is explicitly outside the application's database.  There are times it will be deleted by MC although I'm pretty sure there is a popup.

It is not a mirror.

Manually?  How do you keep track of so many files in your head?
No.

Wouldn't rm fred.* get rid of any type file?
Yes.

So, if you had fred.ape and encoded it to fred.wmv then change to encoding it as fred.mp3 then you'll have both fred.wmv and fred.mp3 in the cache.  If you later delete fred.ape then the cache will delete fred.*.

Or not, apparently.

But like I described.  I renamed an album, so the tags changed.

After synching, I now have a dir in my cache for both the old album name AND the new album name and each dir has mp3 files for each track.  The old album cached files have no value, ever again.  So why are they still around?

Try it, do as I describe and see the result.

It seems to work fine for me.

I'll add some logging under handhelds.

What are your cache settings?  What does the cache directory structure look like?

Logged

slipknot

  • Galactic Citizen
  • ****
  • Posts: 255
Re: Handheld CACHE questions
« Reply #6 on: October 24, 2006, 07:20:39 pm »


It seems to work fine for me.

I'll add some logging under handhelds.

What are your cache settings?  What does the cache directory structure look like?



Like I said, I have albums that no longer exist in my MC library, but the folders and mp3 files still exist in my cache.

My suggestion would be to - after a synch is completed:

1  delete any files/dirs where the track no longer exists in the MC library.
2  delete the oldest files as necessary to keep the cache size within the configured limit.

Thanks.
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: Handheld CACHE questions
« Reply #7 on: October 24, 2006, 10:12:53 pm »

What version of the player are you running?
Logged

slipknot

  • Galactic Citizen
  • ****
  • Posts: 255
Re: Handheld CACHE questions
« Reply #8 on: October 24, 2006, 10:24:14 pm »

What version of the player are you running?

I just tried it with this latest version.  I see the cache files are now deleted that no longer exist in the MC library.  Cool.

It does leave empty directories though for the albums no longer in the MC library (minor).

Thanks.







Media Center Registered 12.0.100 -- C:\Program Files\J River\Media Center 12\

Microsoft Windows XP  Workstation 5.1 Service Pack 2 (Build 2600)
Intel Unknown 2664 MHz MMX / Memory: Total - 2097 MB, Free - 1656 MB

Internet Explorer: 7.0.5700.6 / ComCtl32.dll: 5.82.2900 / Shlwapi.dll: 6.0.2900 / Shell32.dll: 6.0.2900 / wnaspi32.dll: 4.71 (0002) , ASPI for Win32         DLL, Copyright © 1989-2002 Adaptec, Inc. / Aspi32.sys: 4.71 (0002)

Ripping /   Drive X:   Mode:Normal  Type:Auto  Speed:Max
  Drive Y:   Mode:Normal  Type:Auto  Speed:Max
  Digital playback: Yes /  Use YADB: Yes /  Get cover art: No /  Calc replay gain: Yes /  Copy volume: 32767
  Eject after ripping: Yes /  Play sound after ripping: No 

Burning /  Drive X: CDWRITER IDE5232            Addr: 1:0:0  Speed:52  MaxSpeed:52  BurnProof:Yes
  Drive Y: ATAPI    DVD RW             Addr: 1:1:0  Speed:40  MaxSpeed:40  BurnProof:Yes
  Test mode: No /  Eject after writing: Yes /  Direct decoding: Yes /  Write CD-Text: Yes
  Use playback settings: No /

Portable Device Info
  Removed devices:
Logged

PDP8User

  • Recent member
  • *
  • Posts: 19
  • I may be old but I don't remember being senile
Re: Handheld CACHE questions
« Reply #9 on: November 05, 2006, 03:22:27 pm »

I love your HH Cache! :D
In itself it's enough to make me upgrade, as I'll no longer have to maintain parallel libraries of lossless & lossy compression versions of my music.

But:
I have my cache set up as below, with no separate cache per device.
Why then must I have a device attached to build the cache? It takes some time and I'd prefer to be carrying the HH around listening to it while this is happening :)

If I attempt to build cache with no device, MC crashes abruptly :(

Cheers and keep up the good work.
Brian
 


System Info:
Media Center 12.0.106 -- C:\Program Files\J River\Media Center 12\

Microsoft Windows XP  Workstation 5.1 Service Pack 2 (Build 2600)
AMD Unknown 2000 MHz MMX / Memory: Total - 1047 MB, Free - 408 MB

Internet Explorer: 6.0.2900.2180 / ComCtl32.dll: 5.82.2900 / Shlwapi.dll: 6.0.2900 / Shell32.dll: 6.0.2900 / wnaspi32.dll: 4.60 (1021) , ASPI for Win32 (95/NT) DLL, Copyright © 1989-1999 Adaptec, Inc. / Aspi32.sys: 4.60 (1021)

Ripping /   Drive D:   Mode:ModeSecure  Type:Auto  Speed:Max
  Drive E:   Mode:ModeSecure  Type:Auto  Speed:Max
  Digital playback: Yes /  Use YADB: Yes /  Get cover art: No /  Calc replay gain: Yes /  Copy volume: 32767
  Eject after ripping: Yes /  Play sound after ripping: No 

Burning /  Drive D: HL-DT-ST DVDRAM GSA-4163B   Addr: 0:0:0  Speed:40  MaxSpeed:40  BurnProof:Yes
  Test mode: No /  Eject after writing: Yes /  Direct decoding: Yes /  Write CD-Text: Yes
  Use playback settings: Yes /

Portable Device Info
  Removed devices:
Logged
Brian

envyc

  • Regular Member
  • Junior Woodchuck
  • **
  • Posts: 54
  • Change this by choosing profile
Add option to Scheduler for Handheld cache build?
« Reply #10 on: November 05, 2006, 07:35:09 pm »

Add option to Scheduler for Handheld cache build?

I would like to see an option to either:-

1. Schedule the Handheld Cache build from within the MC Scheduler so that it only runs at selected times, or;

2. Only build the cache when there are available CPU resources / no user activity.




Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: Handheld CACHE questions
« Reply #11 on: November 06, 2006, 04:35:42 pm »

I connected a hand held.  I started building the cache.  I disconnected the handheld.  Cache kept building.

Do you have exact repro steps for the crash you're seeing?


I love your HH Cache! :D
In itself it's enough to make me upgrade, as I'll no longer have to maintain parallel libraries of lossless & lossy compression versions of my music.

But:
I have my cache set up as below, with no separate cache per device.
Why then must I have a device attached to build the cache? It takes some time and I'd prefer to be carrying the HH around listening to it while this is happening :)

If I attempt to build cache with no device, MC crashes abruptly :(

Cheers and keep up the good work.
Brian
 


System Info:
Media Center 12.0.106 -- C:\Program Files\J River\Media Center 12\

Microsoft Windows XP  Workstation 5.1 Service Pack 2 (Build 2600)
AMD Unknown 2000 MHz MMX / Memory: Total - 1047 MB, Free - 408 MB

Internet Explorer: 6.0.2900.2180 / ComCtl32.dll: 5.82.2900 / Shlwapi.dll: 6.0.2900 / Shell32.dll: 6.0.2900 / wnaspi32.dll: 4.60 (1021) , ASPI for Win32 (95/NT) DLL, Copyright © 1989-1999 Adaptec, Inc. / Aspi32.sys: 4.60 (1021)

Ripping /   Drive D:   Mode:ModeSecure  Type:Auto  Speed:Max
  Drive E:   Mode:ModeSecure  Type:Auto  Speed:Max
  Digital playback: Yes /  Use YADB: Yes /  Get cover art: No /  Calc replay gain: Yes /  Copy volume: 32767
  Eject after ripping: Yes /  Play sound after ripping: No 

Burning /  Drive D: HL-DT-ST DVDRAM GSA-4163B   Addr: 0:0:0  Speed:40  MaxSpeed:40  BurnProof:Yes
  Test mode: No /  Eject after writing: Yes /  Direct decoding: Yes /  Write CD-Text: Yes
  Use playback settings: Yes /

Portable Device Info
  Removed devices:

Logged

rpalmer68

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 2639
Re: Handheld CACHE questions
« Reply #12 on: February 09, 2007, 12:15:19 am »

I connected a hand held.  I started building the cache.  I disconnected the handheld.  Cache kept building.

Do you have exact repro steps for the crash you're seeing?


Easy!  Just cancel the cache build and start it again without the Handheld connected.

MC will crash (I'm using build .165)

Richard
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: Handheld CACHE questions
« Reply #13 on: February 09, 2007, 10:52:21 am »

The dreaded null pointer.  Next build.
Logged

Craig

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 612
Re: Handheld CACHE questions
« Reply #14 on: February 09, 2007, 12:08:01 pm »

While we're talking about the cache,
If I re-rip a CD and replace my original files, The cache version of the file is not reconverted when a handheld sync takes place.

This means that badly ripped tracks will stay on the handheld untill the mp3's are deleted from the cache.

Craig
Logged
MC2Slim - Windows Shell and JRiver Media Center Integration for Squeezebox.

http://www.duff-zapp.co.uk

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: Handheld CACHE questions
« Reply #15 on: February 09, 2007, 01:02:17 pm »

The cache files are not in the database.  Clear the cache when such things are done.
Logged

Craig

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 612
Re: Handheld CACHE questions
« Reply #16 on: February 10, 2007, 03:04:25 pm »

But tags in the cache get updated, isn't it fair to assume that the files themselves should be?

Craig
Logged
MC2Slim - Windows Shell and JRiver Media Center Integration for Squeezebox.

http://www.duff-zapp.co.uk
Pages: [1]   Go Up