INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1]   Go Down

Author Topic: FLAC files truncated on conversion (transfer)  (Read 5383 times)

herr_schneider

  • Junior Woodchuck
  • **
  • Posts: 74
FLAC files truncated on conversion (transfer)
« on: September 22, 2014, 02:38:15 am »

Hi there,

whenever I select an arbitrary number of flac files for conversion (during handheld sync), an arbitrary number of the converted files will get truncated.
I tested the source files (24/44, 24/48 & 24/96) with flac on the command line -they are all reported ok.
Settings are flac with testing, padding, seek table, compression 6. Leaving out some or all of the options does not change the behaviour. As well it is not predictable which files get corrupted.
The files seem to get corrupted on transfer, because testing the files on the server from the conversion cache, as well as testing files manually copied from the conversion cache to the client machine does not produce errors.
Setup is: server with MC 20 instance (WHS 11), Win 8.1 (64bit) with MC client, connected to the library and requesting the conversion for a file-system "handheld" on a local drive

Note: this only happens with FLAC conversion, not with APE, ALAC, mp3

Logfiles from both server and client are attached.

Thanks for feedback

Marcus

P.S. - Test results inline, logfiles attached.

First Run:

13 files scanned in 3.25 seconds
---
3 files failed
L:\S2Lossy\Bad Religion\True North\01-003-Robin Hood in Reverse.flac   (TRUNCATED @ 2m 52s)
L:\S2Lossy\Bad Religion\True North\01-005-F You.flac   (TRUNCATED @ 2m 12s)
L:\S2Lossy\Bad Religion\True North\01-006-Dharma and the Bomb.flac   (TRUNCATED @ 1m 59s)
---
10 files passed
L:\S2Lossy\Bad Religion\True North\01-002-Past Is Dead.flac
L:\S2Lossy\Bad Religion\True North\01-004-Land of Endless Greed.flac
L:\S2Lossy\Bad Religion\True North\01-007-Hello Cruel World.flac
L:\S2Lossy\Bad Religion\True North\01-008-Vanity.flac
L:\S2Lossy\Bad Religion\True North\01-011-Dept. of False Hope.flac
L:\S2Lossy\Bad Religion\True North\01-012-Nothing to Dismay.flac
L:\S2Lossy\Bad Religion\True North\01-013-Popular Consensus.flac
L:\S2Lossy\Bad Religion\True North\01-014-My Head Is Full of Ghosts.flac
L:\S2Lossy\Bad Religion\True North\01-015-The Island.flac
L:\S2Lossy\Bad Religion\True North\01-016-Changing Tide.flac


Second Run:

16 files scanned in 3.33 seconds
---
3 files failed
L:\S2Lossy\Bad Religion\True North\01-006-Dharma and the Bomb.flac   (TRUNCATED @ 1m 59s)
L:\S2Lossy\Bad Religion\True North\01-010-Crisis Time.flac   (TRUNCATED @ 2m 37s)
L:\S2Lossy\Bad Religion\True North\01-016-Changing Tide.flac   (TRUNCATED @ 2m 14s)
---
13 files passed
L:\S2Lossy\Bad Religion\True North\01-001-True North.flac
L:\S2Lossy\Bad Religion\True North\01-002-Past Is Dead.flac
L:\S2Lossy\Bad Religion\True North\01-003-Robin Hood in Reverse.flac
L:\S2Lossy\Bad Religion\True North\01-004-Land of Endless Greed.flac
L:\S2Lossy\Bad Religion\True North\01-005-F You.flac
L:\S2Lossy\Bad Religion\True North\01-007-Hello Cruel World.flac
L:\S2Lossy\Bad Religion\True North\01-008-Vanity.flac
L:\S2Lossy\Bad Religion\True North\01-009-In Their Hearts Is Right.flac
L:\S2Lossy\Bad Religion\True North\01-011-Dept. of False Hope.flac
L:\S2Lossy\Bad Religion\True North\01-012-Nothing to Dismay.flac
L:\S2Lossy\Bad Religion\True North\01-013-Popular Consensus.flac
L:\S2Lossy\Bad Religion\True North\01-014-My Head Is Full of Ghosts.flac
L:\S2Lossy\Bad Religion\True North\01-015-The Island.flac


Third Run with different target directory / drive:

16 files scanned in 3.58 seconds
---
3 files failed
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-003-Robin Hood in Reverse.flac   (TRUNCATED @ 2m 52s)
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-006-Dharma and the Bomb.flac   (TRUNCATED @ 1m 59s)
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-013-Popular Consensus.flac   (TRUNCATED @ 1m 51s)
---
13 files passed
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-001-True North.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-002-Past Is Dead.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-004-Land of Endless Greed.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-005-F You.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-007-Hello Cruel World.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-008-Vanity.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-009-In Their Hearts Is Right.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-010-Crisis Time.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-011-Dept. of False Hope.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-012-Nothing to Dismay.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-014-My Head Is Full of Ghosts.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-015-The Island.flac
C:\Users\marcusschneider\Music\S2 Test\Bad Religion\True North\01-016-Changing Tide.flac
Logged

herr_schneider

  • Junior Woodchuck
  • **
  • Posts: 74
Re: FLAC files truncated on conversion (transfer)
« Reply #1 on: September 25, 2014, 05:29:37 am »

Is there any difference on site of the server when streaming / transferring flac files resp. APE / ALAC? File sizes are comparable. And I also do not have issues with truncated flac when streaming from the server to the client, resp. when the client accesses the files directly via network share.
Logged

herr_schneider

  • Junior Woodchuck
  • **
  • Posts: 74
Re: FLAC files truncated on conversion (transfer)
« Reply #2 on: October 07, 2014, 03:27:08 am »

Anyone?
Logged

Arindelle

  • Citizen of the Universe
  • *****
  • Posts: 2772
Re: FLAC files truncated on conversion (transfer)
« Reply #3 on: October 07, 2014, 05:01:15 am »

Looked at your logs .. not an expert on this so I'm guessing

Looks like BubbleUPnP Media Server is called  -- isn't this for chromecast??? There are issues I've heard with Chromecast and do not believe JRiver supports Chromecast at this time.

Could you try a normal conversion and stop this process (or plugin) as a test and see if they are still truncated?

do the files get truncated if they were converted locally?
Logged

herr_schneider

  • Junior Woodchuck
  • **
  • Posts: 74
Re: FLAC files truncated on conversion (transfer)
« Reply #4 on: October 07, 2014, 06:10:04 am »

The BubblePNP is a separate thing: I use BubbleUPNP for controlling my MC20 server streaming to my DLNA enabled media players.

The conversion issue is a MC20 Client syncing MC20 Server content against a local file system, conversion done one the server side. As the files in the JRiverConversionCache are not corrupted, corruption must happen during transfer...
My assumption is that it has something to do with FLAC files specifically, as I do not have that issue with mp3, ogg or ape. Did not try wavpack though...
Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 72446
  • Where did I put my teeth?
Re: FLAC files truncated on conversion (transfer)
« Reply #5 on: October 07, 2014, 06:44:23 am »

Looks like BubbleUPnP Media Server is called  -- isn't this for chromecast??? There are issues I've heard with Chromecast and do not believe JRiver supports Chromecast at this time.
Gizmo supports Chromecast.
Logged

Arindelle

  • Citizen of the Universe
  • *****
  • Posts: 2772
Re: FLAC files truncated on conversion (transfer)
« Reply #6 on: October 07, 2014, 09:13:05 am »

Just for the hell of it I'd still try unloading the Bubbleplugin ... why would it be showing up in the log during a conversion?

You might of course be right about the flac files being responsible especially because most of them worked. You can test the files for corruption.

you can try the flac.exe tool at the Flac site ==> (I believe' the command is -t plus any options) https://xiph.org/flac/documentation_tools_flac.html#flac_options_test painful to use though.

Or better yet , this OLD  program that is very fast and easy http://www.vuplayer.com/other.php - just tried it on Win7 64bit and it still works

These will tell if the original file is corrupted or not.

I get truncated flacs sometimes when files names + pāth are excessively long (forget 250 odd characters?) - this can't be the issue with the files you posted.

Are you converting from a local drive to the same local drive out of curiosity or over a network share?
Logged

herr_schneider

  • Junior Woodchuck
  • **
  • Posts: 74
Re: FLAC files truncated on conversion (transfer)
« Reply #7 on: October 08, 2014, 01:52:11 am »

Maybe I was not clear, so here in other words:

1. Server Instance of MC 20, holding the library, mostly 24/96 material. All source material has been tested before conversion / transfer
2. Client Instance of MC 20, connected to the Server library
3. Handheld on Client Instance, requesting converted (flac, 16/44.1) versions of the source material
4. Conversion in this scenario is done at the server, converted files to be found in a local folder at the server instance. All converted files tested before transfer
5. After conversion, files get transferred to the Client, using MC 20 internal means
6. After transfer, an arbitrary number of files is corrupted. Flac test yields in "truncated" as error. Which means that the transfer has been silently interrupted with not error to be found in the logs...

Just for the hell of it I'd still try unloading the Bubbleplugin ... why would it be showing up in the log during a conversion?

There is no unloading of it, as it is no "plugin". It is a DLNA proxy, running at the same machine as the MC 20 Server instance. But for heaven's sake I did a test of the affair with the BuppleUPNP Server deactivated. No change in behaviour...

You might of course be right about the flac files being responsible especially because most of them worked. You can test the files for corruption. [...]

When claiming in my first message that the FLAC files on the source are OK, I did this because I verified with flac commandline the integrity of both the sources (mostly 24bit / 96 kHz material) and the converted material (16bit / 44.1 kHz)...

Are you converting from a local drive to the same local drive out of curiosity or over a network share?

Logged

glynor

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 19608
Re: FLAC files truncated on conversion (transfer)
« Reply #8 on: October 08, 2014, 01:57:30 am »

3. Handheld on Client Instance, requesting converted (flac, 16/44.1) versions of the source material

In the past, I've had a fair bit of trouble syncing handhelds from MC in client mode connected to a Library Server, including failed conversions, uploads, and other things.  It has been a long time since I've used it (since maybe MC15, I don't remember for sure, I do my handheld syncs on the server now), so maybe it should be better now (or is), but... That might be the problem right there.

It shouldn't do that, assuming the source FLACs are okay and whatnot, of course, and I can't say for sure that it is because of that, but...

I tried and tried to set it up so I could sync from my HTPC, and it was a 1000x slower and failed and messed up a lot.  I surrendered after complaining a few times.
Logged
"Some cultures are defined by their relationship to cheese."

Visit me on the Interweb Thingie: http://glynor.com/

herr_schneider

  • Junior Woodchuck
  • **
  • Posts: 74
Re: FLAC files truncated on conversion (transfer)
« Reply #9 on: October 08, 2014, 04:52:23 am »

In the past, I've had a fair bit of trouble syncing handhelds from MC in client mode connected to a Library Server, including failed conversions, uploads, and other things.

Actually I do not sync against a real device, but a virtual handheld (a folder in the local clients file system). Syncing the real device against MC proves to be too troublesome, resp. does not reliably work. For whatever funny reason, keeping a local filesystem in sync is working except for the truncated Flac issues, whereas keeping my handheld in sync does not work at all. Files get deleted upon resync, reuploaded, discarded etc. But that is a different story and has often been discussed in the forum without any solution so far.

I use MC for its capabilities in establishing a networked infrastructure (I love the possibilities the DLNA servers offer especially) and its UI and sound possibilities. But device syncing is a nightmarish topic.
Logged

glynor

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 19608
Re: FLAC files truncated on conversion (transfer)
« Reply #10 on: October 08, 2014, 09:00:40 am »

In my case I was always synching to a "virtual handheld" (folder on disk) as well.

I agree the handeld sync tool could use some work.  I will note though that it works pretty well, as long as you know about some of the idiosyncrasies, from the server itself.
Logged
"Some cultures are defined by their relationship to cheese."

Visit me on the Interweb Thingie: http://glynor.com/

herr_schneider

  • Junior Woodchuck
  • **
  • Posts: 74
Re: FLAC files truncated on conversion (transfer)
« Reply #11 on: October 25, 2014, 07:03:39 am »

The issue persists - and it is clearly related to the transfer between MC client and MC server, as the transcoded files on the server are ok and the files copied through the client to its local hard drive get truncated. Manual copying with whatever program works like a charm. Whatsmore, I have no issues listening in the client, even when I apply the same transcoding for the files as for synching... I wonder why the MC client should not do any verification of the transferred file after transfer and retry on error or at least give a warning to the user.

Imho, this is no exotic use case but one clearly scoped by MCs architecture and I consider this a bug.
Logged
Pages: [1]   Go Up