FTP: The Next Generation
Normally, traditional file transfer tools, such as ftp, scp, and rsync, do not allow us to control the window size or number of streams
- scp and rsync provide on-the-fly compression
- Can run multiple streams “by hand”
- Even with controlling scripts, this rapidly becomes cumbersome
- I’ve done this with ~20 parallel rsyncs!
New tools, bbftp, sfcp, bbcp, and GridFTP all allow these parameters to be changed
- sfcp window size setting is broken and doesn’t provide compression
- bbcp and GridFTP not yet publicly available