Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • splitting fastq?

    I wonder if anyone knows about tools that allow splitting large fastq into smaller chunks. I found a couple scripts that split fasta, but not fastq.

  • #2
    You can use "split" with the -l option (if your sequences/quality values do not wrap around on multiple lines). Check the manual page for split for more details.

    Comment


    • #3
      in unix use:

      wc -l filename ### gets the number of lines

      Then calculate how many lines you want in each smaller chunk to generate clean divisions of the data

      Then:

      split -l {number of lines to split} filename

      Comment


      • #4
        I also asked the same question before
        Discussion of next-gen sequencing related bioinformatics: resources, algorithms, open source efforts, etc
        Last edited by Guest; 02-04-2013, 06:51 AM.

        Comment


        • #5
          Make sure you use numbers that are divisible by 4.

          Comment


          • #6
            If you aren't using Unix, you can get Unix tools by installing Cygwin.
            Like people said, fastq is just a text file, anything that can split a text file will split a fastq file.
            sed is generally slower than split, but you could try it:
            Code:
            sed -n 'start,endp' infile > outfile
            the "p" after "end" means print, the "-n" means only print the selected lines, if you leave it out the original file is copied over and the selected lines appended to it (so don't leave it out).
            e.g. you want a file with a million lines starting from the 4 millionth line:
            Code:
            sed -n '4000000,5000000p' infile > outfile
            Last edited by Jeremy; 02-05-2013, 11:31 PM.

            Comment

            Latest Articles

            Collapse

            • seqadmin
              Essential Discoveries and Tools in Epitranscriptomics
              by seqadmin


              The field of epigenetics has traditionally concentrated more on DNA and how changes like methylation and phosphorylation of histones impact gene expression and regulation. However, our increased understanding of RNA modifications and their importance in cellular processes has led to a rise in epitranscriptomics research. “Epitranscriptomics brings together the concepts of epigenetics and gene expression,” explained Adrien Leger, PhD, Principal Research Scientist on Modified Bases...
              Yesterday, 07:01 AM
            • seqadmin
              Current Approaches to Protein Sequencing
              by seqadmin


              Proteins are often described as the workhorses of the cell, and identifying their sequences is key to understanding their role in biological processes and disease. Currently, the most common technique used to determine protein sequences is mass spectrometry. While still a valuable tool, mass spectrometry faces several limitations and requires a highly experienced scientist familiar with the equipment to operate it. Additionally, other proteomic methods, like affinity assays, are constrained...
              04-04-2024, 04:25 PM

            ad_right_rmr

            Collapse

            News

            Collapse

            Topics Statistics Last Post
            Started by seqadmin, 04-11-2024, 12:08 PM
            0 responses
            37 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 04-10-2024, 10:19 PM
            0 responses
            41 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 04-10-2024, 09:21 AM
            0 responses
            35 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 04-04-2024, 09:00 AM
            0 responses
            55 views
            0 likes
            Last Post seqadmin  
            Working...
            X