Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • merging fastq files

    Hi all,

    We have recently got the fastq files from our RNA-seq experiments. For each treatment we got many fastq file (1Gb each). I'm looking for a way to merge these file before running the analysis (Tophat).

    Thanks,
    Shilo

  • #2
    Shilo,

    Either you can use 'cat' to merge all fastq files:

    cat file1.fq file2.fq file3.fq file4.fq file5.fq > merged.fq

    cat file*.fq > merged.fq

    OR

    Tophat can take them all without merging:

    tophat [options] <index> <file1_1, file2_1, etc...> <file1_2,file2_2, etc...>

    Hope this helps.....

    Comment


    • #3
      Thanks, its work.
      Just to make sure, by using cat it creats one file that merged the previous files and order the data of one file after the other??

      Thanks,
      Shilo

      Comment


      • #4
        Originally posted by shilo View Post
        Thanks, its work.
        Just to make sure, by using cat it creats one file that merged the previous files and order the data of one file after the other??

        Thanks,
        Shilo
        if u do what he said :

        Originally posted by upendra_35 View Post
        Shilo,


        cat file1.fq file2.fq file3.fq file4.fq file5.fq > merged.fq

        cat file*.fq > merged.fq
        then merged.fq will contain all data from file1.fq, file2.fq, file3.fq, file4.fq and file5.fq in that order. Basically you are printing those 5 in that order into file merged.fq instead of onto the terminal.
        Hope that answers your question!

        -A

        Comment


        • #5
          Yes, Thanks a lot

          Comment


          • #6
            This preserves the original files. Can I rather append the second file to the first, to conserve disk space ?

            Comment


            • #7
              If you want to conserve disk space, I recommend gzipping the files, and deleting the originals.

              Comment


              • #8
                I was working on a virtual machine and had only cca 100gb left on the hdd. I have 2 WGS fastq.gz with 50gb each... I solved the problem by allocating extra hdd space to the virtual machine, but I would be nice to know a proven method to append or concatenate fastq.gz-s without temporarily needing extra hdd space.

                Comment


                • #9
                  I've wanted something like that too (for time rather than space reasons), but I don't think it's possible.

                  However, there are a lot of programs that will let you stream from standard in without writing to disk:

                  Code:
                  cat *.fastq.gz | program

                  Comment

                  Latest Articles

                  Collapse

                  • seqadmin
                    Strategies for Sequencing Challenging Samples
                    by seqadmin


                    Despite advancements in sequencing platforms and related sample preparation technologies, certain sample types continue to present significant challenges that can compromise sequencing results. Pedro Echave, Senior Manager of the Global Business Segment at Revvity, explained that the success of a sequencing experiment ultimately depends on the amount and integrity of the nucleic acid template (RNA or DNA) obtained from a sample. “The better the quality of the nucleic acid isolated...
                    03-22-2024, 06:39 AM
                  • seqadmin
                    Techniques and Challenges in Conservation Genomics
                    by seqadmin



                    The field of conservation genomics centers on applying genomics technologies in support of conservation efforts and the preservation of biodiversity. This article features interviews with two researchers who showcase their innovative work and highlight the current state and future of conservation genomics.

                    Avian Conservation
                    Matthew DeSaix, a recent doctoral graduate from Kristen Ruegg’s lab at The University of Colorado, shared that most of his research...
                    03-08-2024, 10:41 AM

                  ad_right_rmr

                  Collapse

                  News

                  Collapse

                  Topics Statistics Last Post
                  Started by seqadmin, Yesterday, 06:37 PM
                  0 responses
                  12 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, Yesterday, 06:07 PM
                  0 responses
                  10 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 03-22-2024, 10:03 AM
                  0 responses
                  51 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 03-21-2024, 07:32 AM
                  0 responses
                  68 views
                  0 likes
                  Last Post seqadmin  
                  Working...
                  X