Taperssection.com

Gear / Technical Help => Post-Processing, Computer / Streaming / Internet Devices & Related Activity => Topic started by: Nick in Edinboro on November 14, 2004, 08:15:25 PM

Title: Need a serious FTP client
Post by: Nick in Edinboro on November 14, 2004, 08:15:25 PM
Say you have 23,000 files (roughly 1.5 gigs) that you need to download from your web server...

SmartFTP chokes on that queue.  Filezilla hammers the server too much and results in about 1 out of 10 downloads successful the rest forcefully aborted.

Anyone suggest an FTP client which can support such a large download or is made for downloading lots of files at once.

Any suggestions appreciated, thanks
Nick
Title: Re: Need a serious FTP client
Post by: dklein on November 14, 2004, 09:53:11 PM
I've been using Bulletproof for years, initially because it was one of the first to support queuing.  I thought it was a common feature nowadays.  In any case, the trial is fully functional for 30 days.  I actually bought this one  ::)
Title: Re: Need a serious FTP client
Post by: Weazel on November 15, 2004, 02:49:36 PM
flashfxp the ftp client that rules them all
Title: Re: Need a serious FTP client
Post by: Lil Kim Jong-Il on November 15, 2004, 03:48:23 PM
Why not tar and compress the file tree and ftp the archive as a single file?
Title: Re: Need a serious FTP client
Post by: nic on November 15, 2004, 03:51:12 PM
Quote from: Maynard G. Beatnik on November 15, 2004, 03:48:23 PM
Why not tar and compress the file tree and ftp the archive as a single file?

ah, *nix speak!   :)
Title: Re: Need a serious FTP client
Post by: Nick in Edinboro on November 15, 2004, 04:35:16 PM
Quote
Why not tar and compress the file tree and ftp the archive as a single file?

Because I don't have access to the server.  It's my webserver, hosted in Pittsburgh by a company that i don't own ;)  FTP is it.

Trust me, if I could terminal service into it somehow and package them I would've already.
Title: Re: Need a serious FTP client
Post by: nic on November 15, 2004, 04:37:19 PM
you can't even SSH/telnet into it ???
Title: Re: Need a serious FTP client
Post by: Nick in Edinboro on November 15, 2004, 05:06:53 PM
The owner has all the ports pertaining ports blocked.. 

He's had issues with "hackers" (probably previous customers) so it's a fairly locked down box.

I would just ask him to compress it but I don't want him to see/realize that I have ~1.6 gigs of photos being hosted at moepics.com considering he gives me free server space :o ;)
Title: Re: Need a serious FTP client
Post by: Nick in Edinboro on November 15, 2004, 05:08:03 PM
BTW, I think I got most of them via SmartFTP--I just cranked down the threading to one thread and put them all in a global queue overnight.  It seems as if most downloaded successfully I might have to go and re-download about 20-50 but that's not really bad.

Thanks everyone for the help...  I appreciate all the advice/tips thusfar!
Title: Re: Need a serious FTP client
Post by: Brian Skalinder on November 16, 2004, 10:43:56 AM
Just write a simple batch file to grab 'em all via FTP either individually, in groups, or all at once.  Somehow I suspect a command-line FTP util won't run into the same problems choking on the large file set.
Title: Re: Need a serious FTP client
Post by: MattD on November 16, 2004, 01:18:46 PM
Brian, you have 1337 tickets :)
Title: Re: Need a serious FTP client
Post by: nic on November 16, 2004, 01:20:14 PM
Quote from: MattD on November 16, 2004, 01:18:46 PM
Brian, you have 1337 tickets :)

h0w 1337!