Hi,
I'd appreciate any advice on moving large sequence/read files (5 GB to 25 GB) among different servers such as Galaxy or the UCSC Genome Browser.
Our campus Linux servers provide 50 GB of storage and only allow secure FTP file transfers (SFTP). To upload a large file to Galaxy, I first have to download the file from the campus server to my Mac desktop, then upload the file to Galaxy or UCSC. This is a painfully slow process (several hours per file).
What I am looking for is a cloud storage site that allows "server-to-server" file transfer so that I can eliminate the download/upload process to my desktop. Most of the services I have tried don't allow file transfers larger than 2 GB or don't support SFTP.
If anyone could help me out with some suggestions, I'd really appreciate it.
JJW
I'd appreciate any advice on moving large sequence/read files (5 GB to 25 GB) among different servers such as Galaxy or the UCSC Genome Browser.
Our campus Linux servers provide 50 GB of storage and only allow secure FTP file transfers (SFTP). To upload a large file to Galaxy, I first have to download the file from the campus server to my Mac desktop, then upload the file to Galaxy or UCSC. This is a painfully slow process (several hours per file).
What I am looking for is a cloud storage site that allows "server-to-server" file transfer so that I can eliminate the download/upload process to my desktop. Most of the services I have tried don't allow file transfers larger than 2 GB or don't support SFTP.
If anyone could help me out with some suggestions, I'd really appreciate it.
JJW
Comment