INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1]   Go Down

Author Topic: RAW files are that difficult?  (Read 2496 times)

Qythyx

  • Galactic Citizen
  • ****
  • Posts: 390
RAW files are that difficult?
« on: January 16, 2008, 07:45:00 am »

I recently got a new digital camera, my first DSLR, a Olympus E-510. I've started saving my pictures (initially) in their RAW form (.ORF), which I'm happy to say that MC supports out of the box (woohoo and kudos!). I've also noticed that when viewing these images in MC, if I try to open one it takes quite a while (~12 seconds) to display it, while which 1 core of my CPU is maxed out. Are these files really that difficult to decode/display? If so, I guess I can live with that, after all the thumbnails are pregenerated and help a lot for browsing.

But, I've also noticed that if I just move my mouse and hover over any of these images my CPU goes to 50% (1 core at 100%) for a some seconds, as if I'm opening the file. I guess this is MC trying to create the popup large preview of the image. Interestingly, for these images the popup almost never actually appears. So...if these CPU during hover is related to the popup, is there any reason MC can't just use the larges size pre-generated thumbnail instead?
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: RAW files are that difficult?
« Reply #1 on: January 16, 2008, 08:07:25 am »

I dunno but you could turn on the raw image cache which would allow you to save pre generated jpegs of your raw files.

Oh, and RAW files are generally brutal on your system.

BTW, what lens did you get with the e-510?  I want the 12-60 but I do not want to switch to Oly.
Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 72446
  • Where did I put my teeth?
Re: RAW files are that difficult?
« Reply #2 on: January 16, 2008, 08:41:54 am »

Thanks.  The raw files are very big and so the time is probably disk access.  Are the files on a local drive?  A network or USB drive could be much slower.
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: RAW files are that difficult?
« Reply #3 on: January 16, 2008, 10:29:35 am »

Even on my new PC it takes a while to open my Xti files.  They are also 10MP images.  Lots of things happening.

Check the playback options.  You can specify lower quality decodes.  This is usually fine for viewing and cataloging and tend to greatly increase the decode speed.
Logged

Qythyx

  • Galactic Citizen
  • ****
  • Posts: 390
Re: RAW files are that difficult?
« Reply #4 on: January 16, 2008, 03:29:52 pm »

In order:

They're on the network, but looking at Taskmanager's network tab I see that downloading this is quite quick, also that wouldn't explain the extended CPU spike.

I got the 14-42mm lens along with a 40-150. I'm also thinking of other lenses, but since this is my first non-point-an-shoot, I want to play with it for a while before deciding what's next.

I'll try saving the RAW + JPEG format and see if that helps.


Thnaks to all.
Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 72446
  • Where did I put my teeth?
Re: RAW files are that difficult?
« Reply #5 on: January 16, 2008, 03:36:23 pm »

CPU useage could also be a virus checker.
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: RAW files are that difficult?
« Reply #6 on: January 16, 2008, 03:41:27 pm »

The RAW file being converted will eat CPU big time.

Have you tried changing the settings under Options->Playback->Images?  The "RAW decode quality" setting would impact decode speed.  And there is also the "RAW Cache: With Files (as JPEG)" option if you want to lose some disk space to gain speed in the future.
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: RAW files are that difficult?
« Reply #7 on: January 18, 2008, 01:55:07 pm »

The RAW file you sent me takes ~5-7s to display on this machine when the RAW image decode quality is set to Default.  Highest is about the same speed.  If set to fastest it looks to be closer to 2s.  I think you might want to play with that setting.
Logged

Qythyx

  • Galactic Citizen
  • ****
  • Posts: 390
Re: RAW files are that difficult?
« Reply #8 on: January 18, 2008, 08:16:20 pm »

Thanks for the advice. I'll take a look. I did turn on RAW caching and that definitely speeds it up for successive views. Is there anyway to pre-generate these JPEGS?
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: RAW files are that difficult?
« Reply #9 on: January 18, 2008, 11:16:40 pm »

Load em up in playing now and leave the room.
Logged

benn600

  • Citizen of the Universe
  • *****
  • Posts: 3849
  • Living: Santa Monica CA Hometown: Cedar Rapids IA
Re: RAW files are that difficult?
« Reply #10 on: January 20, 2008, 11:51:36 pm »

I'm getting ~7 seconds for my 8mp Sony prosumer RAW files over the network (100Mbit).

I don't usually shoot raw and have only a handful of images.

Data transfer (15MB) should take ~1.5 seconds.  So CPU is important.
Logged

Qythyx

  • Galactic Citizen
  • ****
  • Posts: 390
Re: RAW files are that difficult?
« Reply #11 on: January 21, 2008, 12:57:26 am »

The JPEG caching is working well for me now. I did find one bug/annoyance with this, though.

I was trying to do what DarkPenguin suggested to get them all cached. Wanting this to happen as quickly as possible I set the image view time to 2 seconds. I know that's too short for MC to actully load and procees the RAWs, but I assumed it would start the 2 seconds counting from once it actually showed the image. What happened instead is that it worked hard processing one image for about 15 seconds and then showed skipped about 7 or 8 items in the play list (7|8 * 2 = 15 seconds) and marked all the interim images as viewed once. This was annoying because I lost the ability to easily see which ones had been cached. To resolve this I changed the display time to 20 seconds, hoping that would be enough for all images.

Minor issue, but I might as well mention it.

Anyway, after doing precaching them all I'm happy now.
Logged

benn600

  • Citizen of the Universe
  • *****
  • Posts: 3849
  • Living: Santa Monica CA Hometown: Cedar Rapids IA
Re: RAW files are that difficult?
« Reply #12 on: January 21, 2008, 09:35:02 am »

When I loaded my RAW files into MC, in the recently imported playlist they had thumbnails generated before I could even open it!  How are these thumbnails getting generated so quickly?
Logged

DarkPenguin

  • Citizen of the Universe
  • *****
  • Posts: 1921
Re: RAW files are that difficult?
« Reply #13 on: January 21, 2008, 05:57:09 pm »

We pull the thumb from the raw file.  It doesn't require it be completely decoded.  Or maybe it does it at a lower resolution.  (Both were implemented.  Can't remember which method we are currently using.)
Logged

benn600

  • Citizen of the Universe
  • *****
  • Posts: 3849
  • Living: Santa Monica CA Hometown: Cedar Rapids IA
Re: RAW files are that difficult?
« Reply #14 on: January 21, 2008, 09:53:59 pm »

Possibly consider implementing a feature I see on many devices: quickly (and instantly) display the thumbnail full screen stretched and background load the image.

This would help over library server, too.  I usually settle for the small thumbnails because opening an image can take tens of seconds to download.  But a quick full screen, stretched thumbnail would be quick.  Make sure to have an efficient system for canceling downloads and immediately starting the next one if the user skips to the next image.

Also allow this feature to be disabled because it could be less useful on a fast, LAN connection.  Not really necessary there.
Logged

skeeterfood

  • Citizen of the Universe
  • *****
  • Posts: 779
  • We're all just food for the skeeters.
Re: RAW files are that difficult?
« Reply #15 on: January 21, 2008, 10:42:08 pm »

Possibly consider implementing a feature I see on many devices: quickly (and instantly) display the thumbnail full screen stretched and background load the image.

This would work great with Nikon D70 NEFs (not sure about the other Nikons), since they include a full-size jpeg basic image in the RAW file.  Load that initially, then show the decoded NEF when it's done.  Heck, for display purposes the embedded jpeg basic image is usually good enough.  I used to use a program to copy the jpegs out as their own files for fast browsing, but until MC has stacks there was no way to tag the jpegs and the NEFs at the same time...

-John
Logged
Pages: [1]   Go Up