Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • ostrakon
    Junior Member
    • Jan 2011
    • 8

    #1

    Extract index reads from raw Fastq file

    We sequenced some 16S rRNA gene amplicons on our collaborator's MiSeq, and got the raw fastq file that looks like the seqs below.
    It seems that there are only reads_1 and reads_2 in the file, and the index reads are missing.
    In addition, the 1:N:0 or 2:N:0 in the header are missing the sample number as seen in the MiSeq fastq files.
    As I need the index reads to feed the data to Qiime for further analysis, I have the following questions:
    1. Is the index-reads info still in this fastq file?
    2. If yes, Is there a way I can extract the index reads?
    3. If no, besides asking our collaborator for the index reads (which I've done but haven't heard from them), is there any other similar program as Qiime but does not require an index read file as the input?
    Thank you for any feedback.
    @MISEQ04:37:000000000-A2G8E:1:1101:14157:1957 1:N:0:TCCACAGGAGT
    TACAGAGGGTGCAAGCGTTAATCGGAATTACTGGGCGTAAAGCGCGCGTAGGTGGTTTGTTAAGTTGGATGTGAAATCCCCGGGCTCAACCTGGGAACTGCATTCAAAACTGACTGACTAGAGTATGGTAGAGGGTGGTGGAATTTCCTGTGTAGCGGTGAAATGCGTAGATATAGGAAGGAACACCAGTGGCGAAGGCGACCACCTGGACTGATACTGACACTGAGGTGCGAAAGCGTGGGGAGCAAACA
    +
    ?????BB?DDDDDEDDEEEEFFHIHECFFHHHIIIFHHHHIIIEHHHHEHHHAEFEHHEHHEGHHHHHHHHHHHFFFHHHHHHFFEFEFFFFFFFEEEFFFFFFFFFEFFFFFFFFEFFEFFEEFFFFFFFEEFEEFDEEEEEFFFFFFECEEEFEDDED?AACEEEEEDAEEEFEFEFEEEEEEEEEFECEE>?>?8A>;???EEFEEEFFCEE?*1::A:A0CCECA*14)48AEEEE>;;8;88:AC#
    @MISEQ04:37:000000000-A2G8E:1:1101:14157:1957 2:N:0:TCCACAGGAGT
    ACGGACTACCCGGGTTTCTAATCCTGTTTGCTCCCCACGCTTTCGCACCTCAGTGTCAGTATCAGTCCAGGTGGTCGCCTTCGCCACTGGTGTTCCTTCCTATATCTACGCATTTCACCGCTACACAGGAAATTCCACCACCCTCTACCATACTCTAGTCAGTCAGTTTTGAATGCAGTTCCCAGGTTGAGCCCGGGGATTTCACATCCAACTTAACAAACCACCAACCCGCGCTTTACGCCCAGCAATTC
    +
    ?????@@BDDDDDDDDEFFFFFCFFHHHHHHGFHHHHHCDDHHDEDEHHHHHHHFEHFHGGGHHHHHHFCFHHHHF=EEEDCDEHEHHFCFHHEFHFHHFFFFFFFFFFFEEDEEDDDDEE<6@EBCEEFFFFECEEEEECEEE8:CEFFAECECEFAEFE?CEEEECAAAEAEEEFFCEFFFFEE?CEEAEFE'.8?88:?*:AE:CE?*1*:?C*?A?EAEE###########################
    @MISEQ04:37:000000000-A2G8E:1:1101:14713:1991 1:N:0:TCCACAGGAGT
    AACGGAGGGGGCAAGTGTTTCTCGCAATGACTGGGCCTAAAGGGCACGCAGGTGGTTTTCGACAACAGGTATTTCGGTTAAACACTGCAGGCTAACAACAGGTCTGGAATATCTACTAGGAAACTAAGAGTAGTGCTCAGGTCTTTAGAATTGCTAGCGGAGGGGTGGAATCCGGCGAGGCTAGTAGGAATGCTTATGAGTGAAGGCAATTTTCTGGAGCTGACTGACGCTCAGGTGCGCAAGCATGGGGA
    +
    9?????@@DDDDDDDDFFFFFFIEHHHHHHHIIHHIIHHHIHHHIHHEHHHHAEFEHIIIHHHH=FHHHC=DFHFFHEHHFFFFFFFFFDEEEFFFFFFFFFBEEFE=BEEEFFFFEEEEAECEFFFFFFCCEEFFFF?AECAEFFEEEEFFFFFEEEDD8<>DD)8>AEECEA?D?D?D>C?C??:E1?CEEAE?:CAECEAEFFFE8AEEF:?:A:8?*?*:?CAEEEEADCC*0??DD8<?ECEEEE#
    @MISEQ04:37:000000000-A2G8E:1:1101:14713:1991 2:N:0:TCCACAGGAGT
    ACGGACTACTGGGGTATCTAATCCTATTTGATCCCCATGCTTGCGCACCTGAGCGTCAGTCAGCTCCAGAAAATTGCCTTCACTCATAAGCATTCCTACTAGCCTCGCCGGATTCCACCCCTCCGCTAGCAATTCTAAAGACCTGAGCACTACTCTTAGTTTCCTAGTAGATATTCCAGACCTGTTGTTAGCCTGCAGTGTTTAACCGAAATACCTGTTGTCGCAAACCACCTGCGTGCCCTTTAGGCCCA
    +
    AAA?AABBDDDDDD<AFFFGFGHIHFFHHIIHHHHIHIIIIIHHHH@HHIIFHHHHHHHIIHHIIHHGHHFHIIIHHHFCECGHHFHIIHHHHHHHHHHHHHFHDHHHHGGGGGDEEGDEGCGGEEGGGGGGEEGGGEGEEEGCGGCGCEGGGGGGGGGEGGGGEGGEGG?CGGGGGEGGGGGGGGCGEGGCEEGGGGEECEG?C:?828<CCE?EGGGCCCC*.).CC?CEECE8CEC*11CEEE#####
    @MISEQ04:37:000000000-A2G8E:1:1101:13997:2108 1:N:0:TCCACAGGAGT
    TACGTAGGGTGCGAGCGTTAATCGGAATTACTGGGCGTAAAGCGTGCGCAGGCGGTTAATTAAACCAGTTGTGAAATCCCCGGGGTCAACCTGGGAATTGCATCTGTGACTGTATAGCTAGAGTACGGTAGAGGGGGATGGGATTCAGCGGGTAGCCGGGAAAAGCGTAGATATGCCGAGGAAACACGGAGGCGAAGGGAATTCTCTGGAACTGGACTTGCGCTCCTGCACGAAAAGCTGGGGAGGAAACA
    +
    ?????BB?BDDDBBBDDDEEFFHIHHHHHHHIHHHIHHHHIHHHEHECEHECEHH<<<,,,,5,,44+4C,@D,CF,,@FF);@))34AAC################################################################################################################################################################
    @MISEQ04:37:000000000-A2G8E:1:1101:13997:2108 2:N:0:TCCACAGGAGT
    ACGGACTACAAGGGTTTCTAATCCTGTTTGCTCCCCACGCTTTCGTGCATGAGCGTCAGTACAGGTCCAGAGGATTGCCTTCGCCATCGGTGTTCCTCCGCATATCTACGCATTTCACTGCTACACGCGGAATTCCATCCCCCTCTACCGTACTCTAGCTATACAGTCACAGATGCAATTCCCAGGTTGAGCCCGGGGATTTCACAACTGTCTTATATAACCGCCTGCGCACGCTTTACGCCCAGCAATTC
    +
    ?????@@BDDDBDD?BEFFFFFFHIIHHHHHIIHHHIC=DDFFGHHFHHIIIHFCCEEHGHIHHH-AEFHDDFFHHHFGGFFHHHHHFHECDEEDHHDFCDEDDFFDFFF@DDED=DEED=,ACFFAEDEDDAEFFFFE?C??8EEEF:8).:AAAEF?CEAECEA?:::CC:?EEEFFE?CCECE*?*:?ADDD84)*1:?EEEECA*00::*::CE:?>'.A?EDD;''')08*AEAD48?######
  • ostrakon
    Junior Member
    • Jan 2011
    • 8

    #2
    BTW, another question:
    1. Do the sequences look like they've already been de-multiplexed?
    Also, I am suspecting the index reads are missing b/c I only saw long reads like the ones shown above, but not the shorter ones seen elsewhere.

    Comment

    • GenoMax
      Senior Member
      • Feb 2008
      • 7142

      #3
      The reads are already de-multiplexed. The tag for the particular sample is appended to the end of the ID line (example below from your data)

      @MISEQ04:37:000000000-A2G8E:1:1101:13997:2108 2:N:0:TCCACAGGAGT

      The two reads (pairs R1--> <--R2) also appear to have been already interlaced.
      Last edited by GenoMax; 02-13-2013, 11:32 AM.

      Comment

      • GenoMax
        Senior Member
        • Feb 2008
        • 7142

        #4
        I assume you have multiple sample files? Each file should have the sample_ID (somewhere in the file name).

        Comment

        • ostrakon
          Junior Member
          • Jan 2011
          • 8

          #5
          Originally posted by GenoMax View Post
          I assume you have multiple sample files? Each file should have the sample_ID (somewhere in the file name).
          Thanks GenoMax. For this raw Fastq file I got the sequences from, it is a pooled sample of multiple indexed-samples.

          Comment

          • GenoMax
            Senior Member
            • Feb 2008
            • 7142

            #6
            Originally posted by ostrakon View Post
            Thanks GenoMax. For this raw Fastq file I got the sequences from, it is a pooled sample of multiple indexed-samples.
            So hopefully you have the mapping of "tags" <--> "sample_ID" and can split the original file, if needed.

            Comment

            • ostrakon
              Junior Member
              • Jan 2011
              • 8

              #7
              Originally posted by GenoMax View Post
              So hopefully you have the mapping of "tags" <--> "sample_ID" and can split the original file, if needed.
              Thank you again, GenoMax. I have the mapping info. I am very glad that the Qiime guys have resolved this issue. They made a python script to parse the raw fastq files, extract the index, and add fake quality scores to make an index read file. I am now happily splitting libraries using the mapping info and the index read file generated this way.

              Here is the reference in case anyone has a similar fastq file as mine:

              https://groups.google.com/forum/?fromgroups=#!topicsearchin/qiime-forum/mariana$20illumina$20sequencing/qiime-forum/TJOtt13jlPs

              Comment

              Latest Articles

              Collapse

              • SEQadmin2
                Multiomic Liquid Biopsy: What DNA/RNA Panels Reveal That DNA Alone Can’t
                by SEQadmin2



                Tumors contain complex mixtures of cell populations that evolve in response to treatment and host-specific factors. Tissue biopsies provide only static snapshots of a tumor’s state. But what if we could follow that evolution over time using a minimally invasive technique?

                Liquid biopsies can detect tumor-derived material circulating in the bloodstream, providing a way to study treatment response, detect emerging resistance, and discover new biomarkers. Circulating
                ...
                10-14-2026, 09:55 AM
              • SEQadmin2
                New Genomics Technologies Take Aim at Long-Standing Limits
                by SEQadmin2


                Researchers using sequencing and genomics tools often have to make trade-offs. They can choose between speed or scale, short reads or long-range information, or targeted panels or a view of the whole transcriptome. New technologies that have been released this year are built to address those tough choices.

                We asked six companies the same four questions to learn about their latest products. The new technologies bring a lot to the table, including rethinking sequencing
                ...
                09-28-2026, 10:25 AM

              ad_right_rmr

              Collapse

              News

              Collapse

              Topics Statistics Last Post
              Started by SEQadmin2, 10-22-2026, 11:13 AM
              0 responses
              34 views
              0 reactions
              Last Post SEQadmin2  
              Started by SEQadmin2, 10-22-2026, 10:48 AM
              0 responses
              23 views
              0 reactions
              Last Post SEQadmin2  
              Started by SEQadmin2, 10-15-2026, 10:52 AM
              0 responses
              41 views
              0 reactions
              Last Post SEQadmin2  
              Started by SEQadmin2, 10-14-2026, 05:39 AM
              0 responses
              45 views
              0 reactions
              Last Post SEQadmin2  
              Working...