Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • FTP transfer - corrupt files at other end

    Hello members,

    I've 218 genome (E. coli) files - 436 fastq.gz files.

    I created their symbolik links in one folder (as they are scattered over multiple sequencing folders and different depths of directory), and sent them using bash script via FTP utility.

    I do not get any error, warning or whatsoever during transfer. I can see their size at FTP web interface as in on command line interface on my end.

    But the data on the other end is corrupted.
    I'm unable to understand what might be causing this, and how should I fix this?

    Please guide.
    Last edited by bio_informatics; 08-17-2015, 04:33 AM.
    Bioinformaticscally calm

  • #2
    Did you set "binary on" ?

    You have to set "binary on" when using FTP.

    Comment


    • #3
      Originally posted by Richard Finney View Post
      Did you set "binary on" ?

      You have to set "binary on" when using FTP.
      Hi Richard,
      Thanks for your reply.
      It by default says:

      Uploading in BINARY file XTGEN_20121130_SN180_IL100028322_TTGGTATG-FMC_UTI_01875_L004_R1_trimmed.fastq.gz
      Bioinformaticscally calm

      Comment


      • #4
        What FTP program are you using? Some FTP programs can't follow soft-links correctly.

        Comment


        • #5
          Originally posted by GenoMax View Post
          What FTP program are you using? Some FTP programs can't follow soft-links correctly.
          Hello genomax,
          FTP linux utility.
          Bioinformaticscally calm

          Comment


          • #6
            Have you tried sftp instead of plain ftp?

            Comment


            • #7
              Originally posted by GenoMax View Post
              Have you tried sftp instead of plain ftp?
              Hi,

              I cannot use CURL, stfp as the user name I've has already an @ in it, and thus, many command line transfer utilities refuse to accept it.

              something like:

              user@group_name

              Bioinformaticscally calm

              Comment


              • #8
                Can you clarify what you are trying to do?

                Is this transfer between servers i.e. you have created a symlinked folder of files on server A that you are trying to get at from server B (via the web?).

                Comment


                • #9
                  Originally posted by GenoMax View Post
                  Can you clarify what you are trying to do?

                  Is this transfer between servers i.e. you have created a symlinked folder of files on server A that you are trying to get at from server B (via the web?).
                  Hi Genomax,
                  I created symlinks at remote server A.
                  Wrote bash script at Server A, with FTP which uses - password, username of Server B. This bash script loops over .fastq.gz files (which are symlinks here).

                  Folder:
                  -->has 436 symlinks..

                  From Server A fastq.gz -->FTP Server B

                  bash script.sh inside the symlinks folder.
                  Bioinformaticscally calm

                  Comment


                  • #10
                    Originally posted by bio_informatics View Post
                    Hi,

                    I cannot use CURL, stfp as the user name I've has already an @ in it, and thus, many command line transfer utilities refuse to accept it.

                    something like:

                    user@group_name

                    Try the options included here to handle the @ for sftp: http://unix.stackexchange.com/questi...ontains-symbol

                    Comment

                    Latest Articles

                    Collapse

                    • seqadmin
                      Strategies for Sequencing Challenging Samples
                      by seqadmin


                      Despite advancements in sequencing platforms and related sample preparation technologies, certain sample types continue to present significant challenges that can compromise sequencing results. Pedro Echave, Senior Manager of the Global Business Segment at Revvity, explained that the success of a sequencing experiment ultimately depends on the amount and integrity of the nucleic acid template (RNA or DNA) obtained from a sample. “The better the quality of the nucleic acid isolated...
                      03-22-2024, 06:39 AM
                    • seqadmin
                      Techniques and Challenges in Conservation Genomics
                      by seqadmin



                      The field of conservation genomics centers on applying genomics technologies in support of conservation efforts and the preservation of biodiversity. This article features interviews with two researchers who showcase their innovative work and highlight the current state and future of conservation genomics.

                      Avian Conservation
                      Matthew DeSaix, a recent doctoral graduate from Kristen Ruegg’s lab at The University of Colorado, shared that most of his research...
                      03-08-2024, 10:41 AM

                    ad_right_rmr

                    Collapse

                    News

                    Collapse

                    Topics Statistics Last Post
                    Started by seqadmin, Yesterday, 06:37 PM
                    0 responses
                    10 views
                    0 likes
                    Last Post seqadmin  
                    Started by seqadmin, Yesterday, 06:07 PM
                    0 responses
                    9 views
                    0 likes
                    Last Post seqadmin  
                    Started by seqadmin, 03-22-2024, 10:03 AM
                    0 responses
                    49 views
                    0 likes
                    Last Post seqadmin  
                    Started by seqadmin, 03-21-2024, 07:32 AM
                    0 responses
                    67 views
                    0 likes
                    Last Post seqadmin  
                    Working...
                    X