More > JRiver Media Center 23 for Linux

Problem importing large library

<< < (5/6) > >>

madbrain:

--- Quote from: blgentry on October 02, 2017, 03:49:58 pm ---Something is clearly wonky with your setup.  I think MC is the least likely problem, but I could certainly be wrong.  It might be MC's fault.  I suspect your hardware because you say it is so slow.  Again, I could be wrong.

--- End quote ---

The XU4 is extremely fast when used from an SSH terminal. Only the GUI is slow. I haven't bothered to try to solve it since I am using the box mostly as a file/media server.


--- Quote ---What would really tell the story is if MC on a "real" Linux PC imported all of your files successfully.  If that failed also, the MC for Linux would be a real suspect in this import problem.

--- End quote ---

I don't have a "real" Linux PC, but I could try a VM.


--- Quote ---BTW, this is a separate debate, but MC on the Pi works just fine as a media player.  I control mine with EOS remote on Android and it does everything I want.  Maybe you have some sort of different use case from me.

--- End quote ---

Not sure if you noticed, but I tested MC on my Pi3 also, and it has the exact same problem as the XU4 importing my library and showing only about 5000 files afterwards.
It's definitely not an issue just with my XU4 hardware, since it's common to both the XU4 and Pi3.

I would say it's likely a bug with the MC Linux ARM version that is only triggered in a specific situation with my library.
Not sure if it exists on MC Linux x86/x64 too, but that's not the platform I'm using.

And yes, our use cases are quite different. My Pi3 and XU4 are both running headless. The only things attached are network cable, Ethernet cable, and some USB hard drives.
I need fast I/O for movies - my BR movie collection is in ISO on the hard drive. Pi3 can barely stream one Bluray ISO with its networking. It cannot stream 2 Bluray ISO to different clients in the house.

I have also added 13 Chromecast audios in the house for many different locations. Big house. Will be adding 2 more CA this week. This needs network bandwidth too when using lossless and streaming to the Chromecast audio losslessly. Epecially if one is playing different stuff in each zone. Pi3 I/O simply cannot do it. XU4 can. Only problem is MC cannot deal with my library on either one so far ...

blgentry:

--- Quote from: madbrain on October 02, 2017, 07:21:27 pm ---I don't have a "real" Linux PC, but I could try a VM.
--- End quote ---

That might tell you something.


--- Quote ---Not sure if you noticed, but I tested MC on my Pi3 also, and it has the exact same problem as the XU4 importing my library and showing only about 5000 files afterwards.
--- End quote ---

Ahhh, right.  I think I glossed over that detail.  Seems like my theory about your hardware is probably incorrect.


--- Quote ---I would say it's likely a bug with the MC Linux ARM version that is only triggered in a specific situation with my library.
--- End quote ---

You talked above about copying folders to different folder names.  Then you talked about importing a problematic folder of 28 WMAs.  Did you copy that folder somewhere else too?  I ask because I wonder if there are some "strange" characters in one or more of your top level directories that might be confusing the import process in some way.


--- Quote ---And yes, our use cases are quite different. My Pi3 and XU4 are both running headless. The only things attached are network cable, Ethernet cable, and some USB hard drives.
--- End quote ---

My Pi3 is the same:  Headless.  Not even an ethernet cable actually; just wifi, power cable, USB hard drive, and USB DAC.


--- Quote ---I need fast I/O for movies - my BR movie collection is in ISO on the hard drive. Pi3 can barely stream one Bluray ISO with its networking. It cannot stream 2 Bluray ISO to different clients in the house.
--- End quote ---

Hmmm.  I'd be skeptical of that working well.  But hey, that's not the issue we are trying to solve so...


--- Quote ---I have also added 13 Chromecast audios in the house for many different locations. Big house. Will be adding 2 more CA this week. This needs network bandwidth too when using lossless and streaming to the Chromecast audio losslessly. Epecially if one is playing different stuff in each zone. Pi3 I/O simply cannot do it. XU4 can. Only problem is MC cannot deal with my library on either one so far ...

--- End quote ---

I understand that you are explaining how fast the networking is on your XU4.  I'm unconcerned with that for purposes of this discussion, but it's interesting to know; might be useful to me in the future.

I guess I really don't have anything more to suggest at this point.  Maybe one of the staff here could figure something out if you enabled logging, did the import, and then attached the log file here.

Brian.

madbrain:

--- Quote from: blgentry on October 02, 2017, 07:36:53 pm ---You talked above about copying folders to different folder names.  Then you talked about importing a problematic folder of 28 WMAs.  Did you copy that folder somewhere else too?  I ask because I wonder if there are some "strange" characters in one or more of your top level directories that might be confusing the import process in some way.

--- End quote ---

No, I didn't copy that WMA folder anywhere else. It was just a subfolder from the original tree that I had imported in full.


--- Quote ---My Pi3 is the same:  Headless.  Not even an ethernet cable actually; just wifi, power cable, USB hard drive, and USB DAC.

--- End quote ---

My Pi3 and XU4 are in a home office. No DAC attached. The real PC next to it has 2 Firewire audio interfaces, Echo Audiofire 12 and 8a, total of 20 analog in / 20 analog out, with great 192 kHz/24 bit DACs and ADCs on each one (though the Windows driver unfortunately only supports 96 kHz, Mac driver does 192k but I don't have one).


--- Quote ---Hmmm.  I'd be skeptical of that working well.  But hey, that's not the issue we are trying to solve so...

--- End quote ---

There really is nothing to solve there, that part just works. I just mount share the XU4 drive by Samba, mount it on the HTPC, double click on the ISO to mount it with Virtual clone drive, and play with PowerDVD. Have watched many BR movies that way - no problem. One HTPC downstairs is wired gigabit, the other HTPC upstairs is on Wifi AC with about 400 Mbps effective throughput.
The Toshiba N300 6TB drive I bought recently can easily handle 2 BR streams, and the XU4 networking keeps up, as does the Orbi Wifi mesh.


--- Quote ---I guess I really don't have anything more to suggest at this point.  Maybe one of the staff here could figure something out if you enabled logging, did the import, and then attached the log file here.

--- End quote ---

Sure.

blgentry:

--- Quote from: madbrain on October 02, 2017, 07:48:35 pm ---My Pi3 and XU4 are in a home office. No DAC attached. The real PC next to it has 2 Firewire audio interfaces, Echo Audiofire 12 and 8a, total of 20 analog in / 20 analog out, with great 192 kHz/24 bit DACs and ADCs on each one (though the Windows driver unfortunately only supports 96 kHz, Mac driver does 192k but I don't have one).
--- End quote ---

OK I'm way confused.  Why are you using the Pi and XU4 at all if you have a real PC with good DACs?  Oh wait, for the Chromecasts?  Why even bother?  Why not use the PC?

Brian.

madbrain:

--- Quote from: blgentry on October 02, 2017, 07:54:07 pm ---OK I'm way confused.  Why are you using the Pi and XU4 at all if you have a real PC with good DACs?  Oh wait, for the Chromecasts?  Why even bother?  Why not use the PC?

Brian.

--- End quote ---

The real PC and the great DACs are used for recording, mainly. And they are only in a single room.
The real PC uses tons of power and can't be used 24/7 as a server for that reason. Everything is always in standby mode when not in use. Amps/DAC/etc are all on remote X10 switches to turn them off when not in use. Everything that's idle and consuming significant power also generates heat, which in turns drives up AC costs too. The price of electricity is expensive in California. Even though I have solar PV, I also have 2 electric cars also, and a huge house, with 2 central ACs, a hot tub, and a sauna, I still end up having net positive usage, and a net bill. Marginal cost is still about 30 cents/kWh. A 100W PC (that's about how much it uses when idle) will cost $262/year to run 24/7. An XU4 at 20W (counting external SATA dock and drive) will be $52/year in comparison.  So, that is the rationale.

I bought the Pi and XU4 exclusively to limit the power consumption, and have 24/7 access to media / files from anywhere in the house (smartphone, HTPCs, and now Chromecsts). I like that they are fanless and quiet, also, vs the PC which isn't.

All the Chromecasts were added just recently in the last week to finally make better use of all the ceiling speakers that came with the house. Just about 15W idle power consumption for a total of 13 Chromecasts. And I may put those on remote power switches too since the 5 amps needed to power 13 zones consume a total of 300W idling, and definitely have to be on switches. 300W running 24/7 = enough electricity to do all the driving in a year for one of my two EVs. My next project is to play with the Wifi smartplugs I bought this weekend for this purpose. X10 PLC signals won't work well accross floors and half the amps and Chromecast are upstairs, half downstairs. I'm afraid I have to retire X10 in my house, at least for new usage. I have 4 X10 hardwired light switches in my house, all on the first floor, and PLC signals sent by my XU4 or Pi3 reach all of them, but won't be adding more X10 gear to my house.

Navigation

[0] Message Index

[#] Next page

[*] Previous page

Go to full version