INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1]   Go Down

Author Topic: Help! How to check which files are Corrupted !!*^&  (Read 4842 times)

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Help! How to check which files are Corrupted !!*^&
« on: August 18, 2012, 02:42:57 am »

I'd finished all my ripping etc, the my new HighPoint 2720SGL arrived so I put the 6 x 4TB HDD on that, but after a couple of boots (during the installation) I got a CHCKDSK error
- Error detected in index $I30
       then a couple of hours of repeated
- recovering orphaned file xxx to directory xxxx

At first it all seemed fine but ... some files are stuffed.  It turns out that MC will fail to play say "song.mp3" and if I check it with media info it is actually a bit of a video!

Is there anyway of using MC to check for corrupted files?  I've check my Home Videos by hand (each will open and seek) but there is no way I can do this with the 1'000s of Audio, Pic and Other Video files.  I did think to try:
* Audio:  --> analyse audio but MC either hangs or complains the last few files could not be analysed and the process stops.
* How about reimporting into a new library?
* Other Ideas?

 :'(  Sad day....
Logged
JRiver CEO Elect

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Re: Help! How to check which files are Corrupted !!*^&
« Reply #1 on: August 18, 2012, 03:16:40 am »

PICs are easy - just view them by thumbnail.  Not to many of these....
Logged
JRiver CEO Elect

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Re: Help! How to check which files are Corrupted !!*^&
« Reply #2 on: August 18, 2012, 03:31:32 am »

Imported the Audio to a new Library then did a ~d=b to find the "bad ones" - about 1,500 all up but not too bad
Logged
JRiver CEO Elect

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Re: Help! How to check which files are Corrupted !!*^&
« Reply #3 on: August 18, 2012, 05:36:46 am »

Video is going to be fun....

Just check some files and we recently went to the Inca Trail and now some of the clips contain bits from "The West Wing"... oddly I don't remember Jed Bartlet slogging it out with us...  :-X
Logged
JRiver CEO Elect

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Re: Help! How to check which files are Corrupted !!*^&
« Reply #4 on: August 18, 2012, 05:43:45 am »

Given this issues, I'm now running a Sync Toy check from my backup server (doing a bit sum check) but this will take a loooooong time.  Also I may have commited some changes to the backup server already + it does not hold the physical BD's that I ripped (so I guess I may have to re-rip some or all of them)  :'(
Logged
JRiver CEO Elect

marko

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 9139
Re: Help! How to check which files are Corrupted !!*^&
« Reply #5 on: August 18, 2012, 06:16:45 am »

ouch!

leezer3

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 1588
Re: Help! How to check which files are Corrupted !!*^&
« Reply #6 on: August 18, 2012, 06:22:39 am »

Massive RAID array?
That's one of the reasons I like single disks so much. If I loose a disk, it only affects the one disk with no possibility of affecting anything else.

Admittedly, I also don't do backups (A lot of people on the main MC board think I'm mad), but in 10 years, I've never managed to loose any data from a dead disk.
I also seriously dislike NTFS as a filesystem, no journaling of data writes, just metadata. You should try a decent and well *Nix based filesystem- My personal preference is for XFS  ;D

Serious ouchies though, I feel for you.
I have suggested in the past MC storing an MD5 (or equivilant) checksum for every file in the library to help with situations like this, perhaps it's time to raise this possibility again.

-Leezer-
Logged

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Re: Help! How to check which files are Corrupted !!*^&
« Reply #7 on: August 18, 2012, 06:39:59 am »

Mmmm the ability for MC to Generat, Store then compare Bitsums would help no end....   Anyway, I'm guessing it was the change of controller that caused the issues... but I've never seen anything like this before.. FYI I have 6 x 4TB Sata HDD presented as one Vol using Drive Bender (it just uses NTFS Mount Points) as I avoid RAID like the plague.  It goes to show nothing beats backups but it takes soooooo loooong with the size.  Also I may have committed corrupted changes...so I REALLY like your idea of generating and storing the BitSum them the ability to check against it later.  Given the size I'm guessing it is some days to check what needs to be fixed.
Logged
JRiver CEO Elect

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 72439
  • Where did I put my teeth?
Re: Help! How to check which files are Corrupted !!*^&
« Reply #8 on: August 18, 2012, 06:55:34 am »

Monkey's Audio has a checksum feature.
Logged

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Re: Help! How to check which files are Corrupted !!*^&
« Reply #9 on: August 18, 2012, 07:07:56 am »

An potential MC feature could be do do a background generation of MD5 (or other Bitsum) on all media files (Audio, Video, Pic etc) and store them in the library (and where supported write to a tag or sidecare file) for latter comparison.
Logged
JRiver CEO Elect

glynor

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 19608
Re: Help! How to check which files are Corrupted !!*^&
« Reply #10 on: August 18, 2012, 09:53:02 am »

An potential MC feature could be do do a background generation of MD5 (or other Bitsum) on all media files (Audio, Video, Pic etc) and store them in the library (and where supported write to a tag or sidecare file) for latter comparison.

SHA1

This should be the filesystem's job.  Creaky old filesystems are annoying.
Logged
"Some cultures are defined by their relationship to cheese."

Visit me on the Interweb Thingie: http://glynor.com/

leezer3

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 1588
Re: Help! How to check which files are Corrupted !!*^&
« Reply #11 on: August 18, 2012, 12:58:35 pm »

Would be better in both places IMHO :)
The issue with only having it in the filesystem is that if an external program validly changes your files (WMP auto-tags for example), then the hash the filesystem holds will remain correct, but the hash you want will now be wrong.

-Leezer-
Logged

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Re: Help! How to check which files are Corrupted !!*^&
« Reply #12 on: August 18, 2012, 03:47:18 pm »

Yeah well - NTFS is Kinda popular so as with all things we need to work with what we have.

Anyway, the SyncToy file compare found 2,702 files that were present (but not the same) from 8,590 just in my Video Editing Folder (about 1/2TB) and is now copying these back.  There would be No Way I could identify all of these manually.

Ohh well - it will give me something to do (I'd hate to get bored)!
Logged
JRiver CEO Elect

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Re: Help! How to check which files are Corrupted !!*^&
« Reply #13 on: August 18, 2012, 03:51:52 pm »

Has anyone any experience with this issue, as I've not seen it before and would like to understand;
- what it is,
- what causes it
- etc

so I can minimise it happening again.

Thanks
Nathan
Logged
JRiver CEO Elect

jmone

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 14463
  • I won! I won!
Re: Help! How to check which files are Corrupted !!*^&
« Reply #14 on: August 19, 2012, 03:57:34 am »

Great....  I've now got a bunch more CHKDSK errors like:
- Deleting Orphan File Record Segment XXX
- Deleting Index Entry
- Replacing Invalid Security ID's

.... so I've updated the RocketRaid BIOS, Windows Drivers, Reformatted all 6 x 4TB HDD and starting to restore from backup (then will have to re-rip all the BDs).....  This will take even longer....
Logged
JRiver CEO Elect

glynor

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 19608
Re: Help! How to check which files are Corrupted !!*^&
« Reply #15 on: August 20, 2012, 06:11:02 pm »

- what causes it

It could be the controller (drivers, BIOS, or hardware), but cabling or a bad drive is more likely.

Replace the SATA cable to the troublesome drive(s).

It might just be a bad disk though.  If you weren't experiencing sudden power failures, and the board seems otherwise stable (you aren't getting crashes and whatnot), then it is probably hardware.  If updating the Highpoint card doesn't fix it, I'd be skeptical of one (or more) of those disks.
Logged
"Some cultures are defined by their relationship to cheese."

Visit me on the Interweb Thingie: http://glynor.com/
Pages: [1]   Go Up