INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1]   Go Down

Author Topic: Library entries deleted for no known reason (+ unexplained hangs/crashes) in v20  (Read 2933 times)

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3981

I am running the latest MC20 & noticed tonight that a bunch of entries from the library have gone missing, in particular it seems a load of BDs that had been broken down into particles (and the bd entry itself deleted from the library) had vanished. Working back through library backups shows that the size of the backup noticeably reduced between 28th & 30th October, restoring that backup from the 28th has restored all those particles.

I am 100% certain I didn't delete these entries. I suspect the answer is no but is there any possible way to determine what happened to trash those entries? I have certainly been affected by increased instability since upgrading to MC20 (similar story of hangs, freezes and 1-2 outright crashes) but nothing I have been able to pin down reproducibly (I have collected a few logs along the way but it's a bit like looking for a needle in a haystack frankly).

Looking back through event viewer for that time period, I can see a few errors from MC20 like

Code: [Select]
Faulting application name: Media Center 20.exe, version: 20.0.27.0, time stamp: 0x54457ec1
Faulting module name: dsp_main.dll, version: 20.0.27.0, time stamp: 0x54457e6b
Exception code: 0xc0000005
Fault offset: 0x0003cd29
Faulting process ID: 0x4f0
Faulting application start time: 0x01cff391000aeb87
Faulting application path: C:\Program Files (x86)\J River\Media Center 20\Media Center 20.exe
Faulting module path: C:\Program Files (x86)\J River\Media Center 20\Plugins\dsp_main.dll
Report ID: 4dbe25c3-5f86-11e4-82ad-bc5ff4cd2ca1
Faulting package full name:
Faulting package-relative application ID:

or

Code: [Select]
Fault bucket 73621937298, type 1
Event Name: APPCRASH
Response: Not available
Cab Id: 0

Problem signature:
P1: Media Center 20.exe
P2: 20.0.27.0
P3: 54457ec1
P4: dsp_main.dll
P5: 20.0.27.0
P6: 54457e6b
P7: c0000005
P8: 0003cd29
P9:
P10:

Attached files:
C:\Users\Matt\AppData\Local\Temp\WEREAB8.tmp.WERInternalMetadata.xml
C:\Users\Matt\AppData\Local\Temp\WEREB17.tmp.appcompat.txt
C:\Users\Matt\AppData\Local\Microsoft\Windows\WER\ReportQueue\AppCrash_Media Center 20._ed26403de0b8c68490fad782e7445c93a181fb_bc271de6_cab_2234f3ff\memory.hdmp
C:\Users\Matt\AppData\Local\Microsoft\Windows\WER\ReportQueue\AppCrash_Media Center 20._ed26403de0b8c68490fad782e7445c93a181fb_bc271de6_cab_2234f3ff\triagedump.dmp

These files may be available here:
C:\Users\Matt\AppData\Local\Microsoft\Windows\WER\ReportArchive\AppCrash_Media Center 20._ed26403de0b8c68490fad782e7445c93a181fb_bc271de6_26005e36

Analysis symbol:
Rechecking for solution: 0
Report ID: 4dbe25c3-5f86-11e4-82ad-bc5ff4cd2ca1
Report Status: 0
Hashed bucket: 993fbeac8cdb8eaad1c5181c79ad64dd

as well as tons of WPNConnectionFailure events (not sure what these are)

I have run a long memtest which revealed no problems. Any suggestions welcome.
Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71655
  • Where did I put my teeth?

... as well as tons of WPNConnectionFailure events (not sure what these are)
I'm not sure, but it looks like something Microsoft.  Try a search.
Logged

glynor

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 19608

Well that's no good!

Unfortunately, the information you posted (while helpful) isn't enough for us to really be able to diagnose the problem.  Please read through this completely:
http://wiki.jriver.com/index.php/Troubleshooting_Guide

The top portion of that document has solutions for some common problems.  It is really targeted at hangs and crashes, so it would be a good place to start.  Please try to make sure you've gone through at least all the basics there.

Then, closer to the bottom, there is a section all about the Stuff We Need to be able to help.  After you've gone through the top stuff, then come back here and post the stuff requested, and we'll do our best to get you sorted out.
Logged
"Some cultures are defined by their relationship to cheese."

Visit me on the Interweb Thingie: http://glynor.com/

glynor

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 19608

Oh yeah, and last-but-not-least... The Library entries being deleted isn't a good sign.  One of the things I'd be most suspicious of is disk health (in particular, the disk wherever your Library is stored, not necessarily the media files themselves).

But, it is worth mentioning... Crashes can, if they happen at a very bad moment, cause corruption in MC's Library (the database behind it).  I'm guessing that's what you're seeing here with the missing entries.

It may also be worth restoring a Library Backup.  MC automatically makes backups periodically, so you should have quite a few going back over weeks and months.  If it has gotten corrupted, then this itself could be the cause of the ongoing crashes.  It could be frustrating to lose some work in your Library over the last week or two... But if the problem just manifested suddenly, and has continued, you might spend a lot of time chasing your tail if the Library itself is just borked.  Instead, if you can "go back" to before the original problem (which could have been something like a sudden power outage or whatever that left the Library in a corrupt state), it might save a lot of heartache and testing.

You can always make a backup now before you do it and revert back to that if it doesn't help, and you've gone back so far you know it was from before the trouble began.
Logged
"Some cultures are defined by their relationship to cheese."

Visit me on the Interweb Thingie: http://glynor.com/

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3981

OK thanks for the reply.

Taking the 1st section of the guide point by point.

Make sure you are running the latest build. - CHECK (am running the beta channel and am keeping up to date)
Check system requirements. - CHECK haswell core i3 4340, samsung evo 840 (local drive, jriver library), 8G RAM, asrock z87 extreme6 mobo, media is provided by an unraid instance which is running in a xen vm on a debian server connected by 2x1G links (aggregated, iperf test shows it can saturate both links), see below for jrmark and attached for reporter outputu
Make a Library Backup. - CHECK
Enable Logging and collect a Log Package showing the problem. - CHECK
Check your Anti-Virus or Security Software. - CHECK windows defender was running with jriver + media drives excluded, have disabled it recently
Check for common disk-related problems.- CHECK - all seems ok as per samsung magician & windows chkdsk
Disable plugins and special skins. - CHECK none running, it's a vanilla jriver install
Look for patterns. - CHECK not been able to deterministically reproduce anything yet, a small hang during "get tv/movie info" is the closest I've come
Report the problem (and do additional troubleshooting if desired).

JRMark
Code: [Select]
=== Running Benchmarks (please do not interrupt) ===

Running 'Math' benchmark...
    Single-threaded integer math... 4.089 seconds
    Single-threaded floating point math... 2.513 seconds
    Multi-threaded integer math... 2.421 seconds
    Multi-threaded mixed math... 1.461 seconds
Score: 1812

Running 'Image' benchmark...
    Image creation / destruction... 0.752 seconds
    Flood filling... 0.658 seconds
    Direct copying... 0.981 seconds
    Small renders... 1.136 seconds
    Bilinear rendering... 1.320 seconds
    Bicubic rendering... 0.853 seconds
Score: 3859

Running 'Database' benchmark...
    Create database... 0.274 seconds
    Populate database... 0.998 seconds
    Save database... 0.205 seconds
    Reload database... 0.055 seconds
    Search database... 0.994 seconds
    Sort database... 0.760 seconds
    Group database... 0.577 seconds
Score: 5564

JRMark (version 20.0.41): 3745
Logged

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3981

This is the closest I've come to any sort of reproducible problem, it's not 100% consistent but it does generally seem to happen

1) put BD in drive
2) wait for AnyDVDHD & JRiver to read it
3) do "Get movie & tv info"
4) pick a selection
5) it whites out for something like 10-15s before it continues normally

https://drive.google.com/file/d/0BxdmSMpV-t3GU0xneXdMQnd5RVU/view?usp=sharing - hang_on_getmovieinfo1
https://drive.google.com/file/d/0BxdmSMpV-t3GUXZLeFV4QXhuMzQ/view?usp=sharing - hang_on_getmovieinfo2

some points that stand out in that log to me are lines like

Code: [Select]
141013157: 1976: Database: CThumbnailsDatabase::AddThumbnail: Finish (1891 ms)
141013157: 1976: General: CThumbnailCacheInfo::CreateThumbnail: Finish (3875 ms)
141013157: 1976: Database: Thumbnail Thread (D:\BDMV\index.bdmv): Finish (3875 ms)

Code: [Select]
2383906: 1304: Database: CThumbnailsDatabase::AddThumbnail: Finish (1922 ms)
2383906: 1304: General: CThumbnailCacheInfo::CreateThumbnail: Finish (3016 ms)
2383906: 1304: Database: Thumbnail Thread (D:\BDMV\index.bdmv): Finish (3016 ms)

I don't know if these are blocking operations though. Are those times (at the end of the line) cumulative or represent individual operations? Is there a way to know which ones might cause the main ui to block? I could easily then grep the logs to find "long" operations, something like

Code: [Select]
egrep '\([0-9]{4,} ms\)' hang_on_getmovieinfo_*/Log.txt | cut -d" " -f3-|sort |less
if I knew what to look for.


Logged

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3981

The crash I did manage to catch logs for was this one

https://drive.google.com/file/d/0BxdmSMpV-t3GX19PSzFsQlphU2M/view?usp=sharing
This one a film was playing in one zone and then I attempted to start music playback using gizmo, it didn't respond and execute the zoneswitch (which should stop the video zone).

https://drive.google.com/file/d/0BxdmSMpV-t3GV3NOSHFwZHpULW8/view?usp=sharing
This one immediately follows the one above, I went and manually stopped the video playback and started music playback. JRiver just outright crashed at this point (and zip contains the dmp)

I haven't been able to reproduce this behaviour.
Logged

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3981

I checked the local disk, windows + samsung magician + SMART report all say it is ok & the samsung magician performance test seems normal.
Logged

glynor

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 19608

The crash I did manage to catch logs for was this one

https://drive.google.com/file/d/0BxdmSMpV-t3GX19PSzFsQlphU2M/view?usp=sharing
This one a film was playing in one zone and then I attempted to start music playback using gizmo, it didn't respond and execute the zoneswitch (which should stop the video zone).

https://drive.google.com/file/d/0BxdmSMpV-t3GV3NOSHFwZHpULW8/view?usp=sharing
This one immediately follows the one above, I went and manually stopped the video playback and started music playback. JRiver just outright crashed at this point (and zip contains the dmp)

I haven't been able to reproduce this behaviour.

That's fantastic.  JRiver guys, if you look at this thread, he got a crash dump.
Logged
"Some cultures are defined by their relationship to cheese."

Visit me on the Interweb Thingie: http://glynor.com/

glynor

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 19608

some points that stand out in that log to me are lines like

Code: [Select]
141013157: 1976: Database: CThumbnailsDatabase::AddThumbnail: Finish (1891 ms)
141013157: 1976: General: CThumbnailCacheInfo::CreateThumbnail: Finish (3875 ms)
141013157: 1976: Database: Thumbnail Thread (D:\BDMV\index.bdmv): Finish (3875 ms)

Code: [Select]
2383906: 1304: Database: CThumbnailsDatabase::AddThumbnail: Finish (1922 ms)
2383906: 1304: General: CThumbnailCacheInfo::CreateThumbnail: Finish (3016 ms)
2383906: 1304: Database: Thumbnail Thread (D:\BDMV\index.bdmv): Finish (3016 ms)

I don't know if these are blocking operations though. Are those times (at the end of the line) cumulative or represent individual operations?

Thumbnail generation while browsing is, unfortunately, a blocking operation, so it explains your hang in that particular instance.

The AddThumbnail line seems long, but I'm not sure off the top of my head how long that whole process should take.  By the way, lines that have a total time in parenthesis are typically the result of an entire "process" and are cumulative.  The three lines you posted from each log are each cumulative with each other (they're in the same thread), meaning that those second two lines (3016 ms in the second example) are referencing the same process from two different perspectives, and were received/recorded less than 1 ms apart, which is why it shows the same 3016 ms twice).  That's good.  It would be bad if there was a jump between those two numbers.

So, the AddThumbnail part might be worth checking (I can look at the whole log later, and compare to one of mine, I don't have time right now), but it is almost certainly okay.

Generally, however, the fact that it takes 3-seconds to complete generating the thumbnail on the D: drive is expected, if not necessarily good behavior.

When you browse in MC it has to generate thumbnails in order to show them in the view, if it doesn't already have a thumbnail in the cache.  This is blocking because it is required for UI display (the main UI thread needs the thumbs before it can proceed).  It is per-file, so it doesn't hang while it builds thumbs for an entire view, but it does hang while it actually generates a single file (converting that item in the displayed list from a "placeholder image thumb" to the actual thumbnail).  So, when you browse most views, it uses the cache first and these all display instantly, and then as you scroll it background generates thumbs and adds them to the cache for each individual item on screen, swapping them out one at a time.  That "UI replace" function is blocking.  I also explain this process fairly well here in "layman's terms".  I think it is pretty well optimized.  It does "feel like" to me that there is maybe an opportunity here to do the UI replace after the thumbnail generation is finished, so then it would just be a display of an already-background-generated thumb.  But, honestly, Matt is good at this stuff, and probably has it optimized that way and as much as is possible.  I'm not sure of the technical details, but I'd be willing to bet the blocking is actually the OS blocking on disk access while the thumbnail is built, and that MC itself has "no choice" but to wait.  Not sure.

The problem in your example instance, of course, is that the file is on an optical disc (and not an online disk part of the Library), so it can't really have the thumbnail pre-generated. As I said, I suspect the problem is OS-level and they can't do much here.  I'm not sure.  This isn't an issue if your Thumbnails are all basically pre-generated, and usually isn't a big issue (because the process is fast, and the actual generation happens in a background thread) with "online" disks.  But in this case, you're spinning up and reading an optical disk (and BluRay structures are hard-and-slow to read anyway) so that is expected to be slow.

It would be nice if you could just prevent it from displaying Thumbs entirely for optical discs, since performance there is always going to be junky.  It would probably be hard or impossible to distinguish between them though, especially when going through a driver like AnyDVD.

I don't think any of this is related to your other problems at all, though.  You've just found a particular instance where MC does typically hang for a little bit.  Your "regular" thumbs aren't an issue here when browsing non-optical disc related Views:

Code: [Select]
Processing
    Thumbnails built: 100% (13450 of 13460)

The crash that happens when you stopped video playback and switched to Music playback "smells like" one of these options:

* an Audio device driver problem
* Problems with the settings in Options > Audio
* video driver problems
* something broken in MC's video playback or audio playback engine, relating to switching between stream types.

Or some combination of the above.  As I said, though, I didn't have time to really dig into your logs (please leave them all up for a while if possible).
Logged
"Some cultures are defined by their relationship to cheese."

Visit me on the Interweb Thingie: http://glynor.com/

glynor

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 19608

Also, thank you VERY much for being so thorough.  That will be very helpful in figuring out what went wrong, and in helping JRiver solve the problem if it is on their end.
Logged
"Some cultures are defined by their relationship to cheese."

Visit me on the Interweb Thingie: http://glynor.com/

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3981

OK thanks. If it's expected behaviour then I will know to ignore it, that particular case doesn't happen v often anyway (as I'm not sitting here ripping discs all day long).

I will leave the logs up as long as required. Any insight you can give is appreciated.

I have made three changes to see if that improves things, I should really have done it one at a time but then I'd be here for a week or so ....

1) disabled windows defender completely
2) removed a vnc server process (which seemed to cause cpu spikes at times
3) moved the cover art location back from a network share to the local drive

I will report back in a few days as to whether this has improved stability/performance or whether it is still somewhat flaky.
Logged

mattkhan

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3981

I realised I had left this thread dangling...

I've left it with windows defender disabled & the vnc server uninstalled for a few weeks now, no issues with hangs or stalls noted. It could be coincidence but that points to one of those processes being the ultimate cause.

I'm going to reinstall a vnc server next (as using RDP is annoying) to see if problems recur or it remains stable.

Logged

terrym@tassie

  • MC Beta Team
  • Galactic Citizen
  • *****
  • Posts: 474

I have had to uninstall VNC on my system because it caused the video display resolution switching to fail (if I played a 23.976 bluray it wouldn't auto switch back to 25 or 29.97 if a PAL or NTSC dvd was played subsequently). I think the VNC mirror driver was having an effect here.
I have switched to Teamviewer (because I find RDP annoying as well) and I haven't had any resolution switching issues since.
This may or may not have any bearing the issues you are seeing but I thought I would let you know.
Logged
" I like work: it fascinates me. I can sit and look at it for hours." -Jerome K. Jerome

krmasson

  • World Citizen
  • ***
  • Posts: 212

Hello,
I had a similar issue 2 days ago. I use MC 20.0.30 under Windows, in a "standalone installation" (MC and all library located on a portable USB drive).

For some reason, I disconnected my drive from my computer during a few hours, after having stopped MC. I plugged the drive back at the end of day, and did nothing more.

Then, the next day, when I started MC again, all disks had disappeared from the library: the library itself (definition of views, and options) was still there, but none of my 15000 tracks was visible.

I had to redo an autoimport of the whole drive (BTW, I also lost the autoimport configuration). All is working fine back.

AFAIK, I did nothing special. Somewhat strange.

Regards
Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71655
  • Where did I put my teeth?

MC has a setting for whether to keep track of files on removable drives.  The options page has a search window at the bottom.
Logged

krmasson

  • World Citizen
  • ***
  • Posts: 212

MC has a setting for whether to keep track of files on removable drives.  The options page has a search window at the bottom.
I know, and it is checked ("protect again missing drives").
And, as I said, I took care to stop MC before unplugging the drive, and to relaunch it only after having plugged the drive back (with same letter).

Anyway, I did not perform any autoimport until I discovered that my library items had vanished.
Logged
Pages: [1]   Go Up