INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1]   Go Down

Author Topic: Uploading to pix01 keeps failing  (Read 17503 times)

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Uploading to pix01 keeps failing
« on: December 02, 2015, 01:37:45 pm »

I've been trying to upload some photos the last couple of days, and have had no success yet.  I'm using crappy, slow, satellite internet at the house, and I suspect the upload might be timing out due to the slowness of my upload ability.  I'm just guessing at this, perhaps there is some other issue, but when I watch the upload progress, the program shows the data being uploaded much faster than my internet is actually able to deliver.

In the latest attempt, it showed uploading (2.7 MB of 5.1 MB) very quickly (too quickly), then sat there for several seconds, then showed Upload Complete in the action window.  A few seconds later, I got a popup box telling me "upload to gallery failed."

Log file attached.
Logged
pretend this is something funny

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71679
  • Where did I put my teeth?
Re: Uploading to pix01 keeps failing
« Reply #1 on: December 02, 2015, 02:02:16 pm »

I just tested an upload to Pix01.  It's working.  Antivirus problem or similar?
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #2 on: December 02, 2015, 02:58:27 pm »

I just tested an upload to Pix01.  It's working.  Antivirus problem or similar?

I assume you don't have really, really slow internet.  I have the same antivirus I've always had, Avast.  However, I've not tried uploading anything since before I moved and had this new internet.

Anything in the logs that points to the problem?

**Oh, I should note, if I reduce the number of photos I try to upload, MC tells me it was successful, but I never get the email with the link, and logging in directly to pix01 also does not show me the new gallery, so something isn't working for me.
Logged
pretend this is something funny

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #3 on: December 02, 2015, 03:02:15 pm »

I just reduced it to only one small photo, and that did actually work now.  I see that gallery on pix01 now.  I guess that means Avast isn't the problem.

So, how do I add more than 1 or 2 photos to pix01?
Logged
pretend this is something funny

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71679
  • Where did I put my teeth?
Re: Uploading to pix01 keeps failing
« Reply #4 on: December 02, 2015, 03:20:45 pm »

It still could be the av program.  They do some really amazing things.

My test was 5 photos.

Check the file types to see if anything is different.

Try testing a single file upload of one of the ones that didn't work.
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #5 on: December 02, 2015, 05:59:42 pm »

Nah, they are all photos I took earlier in the day.  i originally tried uploading 8 or 10 photos, and that failed, then I uploaded just one of those photos, and that one worked.  They are just simple jpg files taken with my phone, then downsized with ThumbsPlus.

I just tried with 5 of the photos, with a total size of 2.4 MB and MC thinks it completed successfully.  I waited about an hour, and I never got the email, nor is the gallery showing up on pix01.

I can't imagine how av could cause this, it really feels like a size/speed problem.  Is there anything in my log file that might give a clue to what's going on?
Logged
pretend this is something funny

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #6 on: December 03, 2015, 03:54:14 am »

I tried uploading just 3 photos, then just 2 photos, and both looked successful from inside MC, but both failed to actually upload to pix01.

So, I got up early today, to try again during my unrestricted internet period from midnight to 5am, and was able to upload 9 photos successfully without issue, so I tried all 12 photos, and that worked fine also.

So, this definitely seems to be an issue with upload speed, since Avast has been running the whole time.  It seems if pix01 doesn't get the data fast enough it just fails.  Perhaps this can be improved.
Logged
pretend this is something funny

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71679
  • Where did I put my teeth?
Re: Uploading to pix01 keeps failing
« Reply #7 on: December 03, 2015, 06:35:42 am »

If it works at night and not during the day, then it is probably your Internet provider fooling around with you.

Pix01 doesn't have a problem with upload speeds.

Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #8 on: December 03, 2015, 08:08:21 am »

It does work during the day, but only for a limited number of photos/size.  At night, they remove my (dial up like) speed limit, so I'm able to upload at a much faster speed, and that lets me upload more photos.

Perhaps as a test you could try uploading a crazy number of photos/huge size and see if that fails for you. That might tell us if size versus speed is an issue.
Logged
pretend this is something funny

marko

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 8973
Re: Uploading to pix01 keeps failing
« Reply #9 on: December 03, 2015, 08:27:05 am »

Test for Justin, 40 files, 98 Mb, created and uploaded in less than a minute...
http://pix01.com/MB1%40IxWm

After creation, upload was reduced from 98 to 15 Mb.

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #10 on: December 03, 2015, 08:34:38 am »

Thanks for testing Marko.  I suspect your internet is way faster than my daytime internet and you didn't stress pix01 enough with your test.

here is my current speed



In the end, I suspect this is just an edge case not likely to warrant developer attention, and I'll just have to do my uploads in the middle of the night, when necessary.  Luckily, this not a common need :)
Logged
pretend this is something funny

marko

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 8973
Re: Uploading to pix01 keeps failing
« Reply #11 on: December 03, 2015, 08:48:32 am »

marko

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 8973
Re: Uploading to pix01 keeps failing
« Reply #12 on: December 03, 2015, 08:51:18 am »

Do you have one of those satellite connections? Aren't those extortionately expensive and plagued with issues?

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #13 on: December 03, 2015, 08:53:10 am »

Ouch!  At least I have to pay $60/month for mine.  I wonder if it's at all offset by the view from my dining room...

Logged
pretend this is something funny

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71679
  • Where did I put my teeth?
Re: Uploading to pix01 keeps failing
« Reply #14 on: December 03, 2015, 08:55:05 am »

I suspect your internet is way faster than my daytime internet and you didn't stress pix01 enough with your test.
This is a problem at your end, probably with your Internet connection.  This is not a Pix01 problem.  
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #15 on: December 03, 2015, 08:57:21 am »

Do you have one of those satellite connections? Aren't those extortionately expensive and plagued with issues?

Yep, Excede Satellite Internet.  Slow, expensive, and unreliable.  There are NO other options where I live in the mountains.  Well, no affordable options.  I can pay Charter $7500 to bring the cable up the road to my property and they won't promise reliability since they would be extending the last node past their internal limit to get it to me.  The other option is to convince them to run fiber up the road to the top of the mountain to serve the 20 or so folks above me, then bring the line back down to me.  They estimate that will cost a few hundred thousand, and don't expect to recoup the investment soon enough to justify it.

So, crappy satellite it is  >:(
Logged
pretend this is something funny

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #16 on: December 03, 2015, 08:58:55 am »

This is a problem at your end, probably with your Internet connection.  This is not a Pix01 problem.  

I suspect it's actually a combination of issues, in that pix01 expects data faster than I'm able to deliver it.  But, as I said, I'll just have to live with it.
Logged
pretend this is something funny

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71679
  • Where did I put my teeth?
Re: Uploading to pix01 keeps failing
« Reply #17 on: December 03, 2015, 09:54:01 am »

I suspect it's actually a combination of issues, in that pix01 expects data faster than I'm able to deliver it.  But, as I said, I'll just have to live with it.
That's not how an Internet connection works.  It could time out if no data was received, but it wouldn't happen in a minute or two, which is different from your description.  In your case, the connection is probably dropped by your Internet provider.

They shouldn't be doing that, even if your bandwidth is restricted.
Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71679
  • Where did I put my teeth?
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #19 on: December 03, 2015, 01:14:41 pm »

I think we are taking about different things.
Logged
pretend this is something funny

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Uploading to pix01 keeps failing
« Reply #20 on: December 03, 2015, 02:26:42 pm »

I suspect it's actually a combination of issues, in that pix01 expects data faster than I'm able to deliver it.  But, as I said, I'll just have to live with it.
I suspected some sort of issue with the upload size but that's not it.
There was something funny going on with your account on Pix01.
The Id you are uploading to wasn't matching your previous Id.
I'm not sure why it started working later on either.
Going to look into it a bit more...
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #21 on: December 03, 2015, 02:34:34 pm »

I suspected some sort of issue with the upload size but that's not it.
There was something funny going on with your account on Pix01.
The Id you are uploading to wasn't matching your previous Id.
I'm not sure why it started working later on either.
Going to look into it a bit more...


Weird, but thank you very much for taking the time to investigate.  I'm happy to help or provide any more information you need from me.

Thanks!
Logged
pretend this is something funny

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Uploading to pix01 keeps failing
« Reply #22 on: December 03, 2015, 03:08:13 pm »

Weird, but thank you very much for taking the time to investigate.  I'm happy to help or provide any more information you need from me.

Thanks!
Got it.
It actually is the speed of upload.
Should be able to iron that one out on this end.
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #23 on: December 03, 2015, 03:28:13 pm »

Great news, thanks again for taking the time to investigate, I really do appreciate it!
Logged
pretend this is something funny

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71679
  • Where did I put my teeth?
Re: Uploading to pix01 keeps failing
« Reply #24 on: December 03, 2015, 03:29:26 pm »

I'm sorry not to have taken this more seriously.  It was a bug.
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #25 on: December 03, 2015, 03:33:52 pm »

No worries Jim, I'm just glad we made progress.  Hopefully the solution will benefit others too.
Logged
pretend this is something funny

mwillems

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 5181
  • "Linux Merit Badge" Recipient
Re: Uploading to pix01 keeps failing
« Reply #26 on: December 03, 2015, 08:51:11 pm »

It certainly benefited me; I had no idea JRiver even operating a picture sharing cloud service.  That's really handy.
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #27 on: December 10, 2015, 08:22:44 am »

Got it.
It actually is the speed of upload.
Should be able to iron that one out on this end.

Any luck with getting this fixed?

I tried to upload a bunch of photos today and it's still failing.  Will I need a new build, or is this an internal/server thing that can just be fixed on your end?

Thanks again.
Logged
pretend this is something funny

Matt

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 42053
  • Shoes gone again!
Re: Uploading to pix01 keeps failing
« Reply #28 on: December 10, 2015, 08:25:33 am »

Fixing it is on Bob's agenda, but he hasn't gotten to it yet.
Logged
Matt Ashland, JRiver Media Center

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Uploading to pix01 keeps failing
« Reply #29 on: December 10, 2015, 03:30:10 pm »

I just made some changes, can you try it again?
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #30 on: December 10, 2015, 05:02:35 pm »

Sorry, no apparent change.  Trying to upload 19 photos showed uploading to about half the full zipped size, then instantly said complete, then eventually gave a failed warning.  Trying with only 3 files appeared to succeed, but no email was ever received, and photos didn't make it to pix01.  it appears to function exactly the same as before :(
Logged
pretend this is something funny

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Uploading to pix01 keeps failing
« Reply #31 on: December 11, 2015, 11:06:14 am »

Sorry, no apparent change.  Trying to upload 19 photos showed uploading to about half the full zipped size, then instantly said complete, then eventually gave a failed warning.  Trying with only 3 files appeared to succeed, but no email was ever received, and photos didn't make it to pix01.  it appears to function exactly the same as before :(
Ok, I'm starting to think the issue isn't on the server side.
I'm going to disable the processing on this side and when you do the next try, let me know and I'll run the processing by hand to see what's going on..
Thanks...
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Re: Uploading to pix01 keeps failing
« Reply #32 on: December 11, 2015, 11:32:19 am »

Ok, I'm starting to think the issue isn't on the server side.
I'm going to disable the processing on this side and when you do the next try, let me know and I'll run the processing by hand to see what's going on..
Thanks...
Okay. I'll try again in a few minutes and let you know what happens.
Logged
pretend this is something funny

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #33 on: December 11, 2015, 12:01:16 pm »

I just tried with a different set of photos, and it failed like it has in the past.  Hopefully you've seen something in your test to help, but either way, I'm happy to continue helping test, so just let me know if you need anything else from me.

thanks
Logged
pretend this is something funny

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Uploading to pix01 keeps failing
« Reply #34 on: December 11, 2015, 04:32:06 pm »

I just ran the processing script by hand which is why you didn't get any messages until now.
2 of the 4 galleries uploaded had errors in the uploaded files. It's possible that MC is timing out too quickly on those.
The other 2 processed supposedly properly. Can you two check and report back?
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #35 on: December 11, 2015, 04:44:42 pm »

I still have not received any emails about my galleries, nor are they showing on my page after logging in.

I also suspect MC is timing out too soon on my end.  I say that because I've been trying to upload about 15MB worth of photos, but when I start the process, MC tells me it's creating, zipping, uploading my files, then it shows it gets to about 2.4 of 5.1MB, then jumps to finished, telling me it really isn't finishing here in MC.

Do my log files from earlier point to anything?  Would new log files help?
Logged
pretend this is something funny

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Uploading to pix01 keeps failing
« Reply #36 on: December 11, 2015, 05:00:58 pm »

I still have not received any emails about my galleries, nor are they showing on my page after logging in.

I also suspect MC is timing out too soon on my end.  I say that because I've been trying to upload about 15MB worth of photos, but when I start the process, MC tells me it's creating, zipping, uploading my files, then it shows it gets to about 2.4 of 5.1MB, then jumps to finished, telling me it really isn't finishing here in MC.

Do my log files from earlier point to anything?  Would new log files help?
I think it's the time it takes to upload and you may have a firewall/nat device on your end that's premature in closing the session control port. See the last paragraph here:
http://www.ncftp.com/ncftpd/doc/misc/ftp_and_firewalls.html
I can think of a way to fix that in MC. There may also be a way to handle it on the server.
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #37 on: December 11, 2015, 05:05:00 pm »

I'm not entirely clueless about networking, but I'm far from an expert.  I can follow directions, but can't take that article and troubleshoot any issues on my end.

Hopefully you can maybe do something with MC to prevent this, but if not, I'll just have to resort to uploading in the middle of the night, when I'm not so restricted.

either way, I appreciate your time and effort in trying to fix this for me/us.
Logged
pretend this is something funny

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Uploading to pix01 keeps failing
« Reply #38 on: December 11, 2015, 05:08:16 pm »

I'm not entirely clueless about networking, but I'm far from an expert.  I can follow directions, but can't take that article and troubleshoot any issues on my end.

Hopefully you can maybe do something with MC to prevent this, but if not, I'll just have to resort to uploading in the middle of the night, when I'm not so restricted.

either way, I appreciate your time and effort in trying to fix this for me/us.
Thanks for the help in discovering the issue.
I just made a change that may make a difference on this end.
If not I suspect it may take a program change.
The other possibility would be for you to change the timeout on your NAT connections if you have that kind of control in the router software.

Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #39 on: December 11, 2015, 06:29:51 pm »

Nope, still not working here.  It loads up to 2.7MB (of 3.5), then waits a bit, then goes away, then eventually fails.  it definitely feels like it's an issue with MC just not letting it upload enough, but I'm not sure why it seems to work when I upload with faster bandwith.

I've attached the only place in my router that seems like it has to do with NAT.  It could be any of the timeouts I have set for 30 seconds, but I don't know enough to know which ones to try changing to test, or if any might even be the issue.
Logged
pretend this is something funny

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Uploading to pix01 keeps failing
« Reply #40 on: December 14, 2015, 10:54:15 am »

Nope, still not working here.  It loads up to 2.7MB (of 3.5), then waits a bit, then goes away, then eventually fails.  it definitely feels like it's an issue with MC just not letting it upload enough, but I'm not sure why it seems to work when I upload with faster bandwith.

I've attached the only place in my router that seems like it has to do with NAT.  It could be any of the timeouts I have set for 30 seconds, but I don't know enough to know which ones to try changing to test, or if any might even be the issue.
How long is it taking to upload that 2.7MB?
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Re: Uploading to pix01 keeps failing
« Reply #41 on: December 14, 2015, 11:25:48 am »

How long is it taking to upload that 2.7MB?
According to the action window, about 15 seconds
Logged
pretend this is something funny

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Re: Uploading to pix01 keeps failing
« Reply #42 on: December 14, 2015, 04:05:17 pm »

According to the action window, about 15 seconds
Can't be a timeout then.
How about temporary file space?
The images themselves (a damaged or missing one?)
Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #43 on: December 14, 2015, 07:20:00 pm »

From the time I click submit, it took 66 seconds to "finish" then another several seconds to actually give me the failure message.  it took about 30 seconds or so after it showed zipping... before it failed.  I should have no problems with temp space, and none of the photos are damaged.  I'll resubmit the exact same files after midnight and confirm they all upload just fine once speed isn't an issue.
Logged
pretend this is something funny

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #44 on: December 15, 2015, 01:26:39 am »

With the exact same files (I just left MC sitting untouched all this time), from the time I click create, it took 22 seconds until it said zipping, then 11 seconds later it finished the 3.8MB processing and the dialog went away.  I didn't get a 'success' window/dialog this time, but a couple minutes later, I got the email with the link to the successfully uploaded gallery.
Logged
pretend this is something funny

bob

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 13601
Re: Uploading to pix01 keeps failing
« Reply #45 on: December 15, 2015, 11:08:39 am »

It sure sounds like something is on a 30 second timeout.
The problem is that your NAT settings don't indicate that.
The timeouts that are set to 30 seconds shouldn't have any effect on the transfer.
I'm going to try a test from a slow connection and see if I can reproduce this to rule the NAT in or out of the picture.


Logged

JustinChase

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 3273
  • Getting older every day
Re: Uploading to pix01 keeps failing
« Reply #46 on: December 15, 2015, 01:43:42 pm »

Thanks again.  if you think my log file will help, just let me know, or if you have anything else you need/want me to try, I'm happy to try it also.

I wonder if a HUGE upload would work the same to test as a slow connection.  i.e. too much data to upload within a certain period of time.

Also, as I mentioned earlier, if I try uploading just 2 or 3 photos, MC acts like it's successful, but nothing ever actually gets uploaded.  Not sure that helps diagnose, but I did find it interesting.
Logged
pretend this is something funny
Pages: [1]   Go Up