Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Discrepancies in Demultiplexing programs - help request

    I have Illumina PE data from a MiSeq run and am finding large discrepancies in the number of reads recovered while demultiplexing.
    Originally, the fastq files provided with the run had very few reads per individual and a large (>4Gb) Undetermined file. I investigated the DemultiplexSummary provided with the run and found that the top 30 indexes found were in fact my indexes but for some reason (??) were not de-multiplexed correctly.
    Using the Fastx-barcode splitter (HammonLab), allowing a 1nucleotide mismatch, I was able to recover a small number of additional reads from the Undetermined file but not nearly the number stated in the summary.
    I then inputted the raw data into Geneious and after trimming the adapters with the bbduk input I de-multiplexed and found significantly more reads but still only approximately half of the number that should be present.

    Some Numbers:
    Barcode CAAAAG/CTTTTG
    DemultiplexSummary: 1,119,171 reads
    Fastq file unaltered from run: 1, 428 reads
    Fastx Barcode Splitter (on undetermined file): 118,031 reads
    Geneious: 574,498 reads

    My questions are:

    1 - why are the different programs giving such disparate results?

    2- Am I misunderstanding the orientation of the barcodes in the reads and thus perhaps searching for them incorrectly? It is my understanding that the "adapter - barcode - read" order should have the barcode as the first 6 bases in the R1 read after adapter trimming (in my example CAAAAG). R2 should not have(?) the barcode - or I should not have to search for a barcode in R2 anyways as I have paired the data? I recovered the reads in Geneious using CTTTTG as that was the index listed in the demultiplexsummary but my barcode as listed in my primer order was CAAAAG so I am concerned that I am misunderstanding a fundamental piece of the puzzle here.

    3 - Most importantly - how do I recover the 1million+ reads?!!?
    Attached Files

  • #2
    Originally posted by biodiverse View Post
    I have Illumina PE data from a MiSeq run and am finding large discrepancies in the number of reads recovered while demultiplexing.
    Originally, the fastq files provided with the run had very few reads per individual and a large (>4Gb) Undetermined file. I investigated the DemultiplexSummary provided with the run and found that the top 30 indexes found were in fact my indexes but for some reason (??) were not de-multiplexed correctly.
    Using the Fastx-barcode splitter (HammonLab), allowing a 1nucleotide mismatch, I was able to recover a small number of additional reads from the Undetermined file but not nearly the number stated in the summary.
    I then inputted the raw data into Geneious and after trimming the adapters with the bbduk input I de-multiplexed and found significantly more reads but still only approximately half of the number that should be present.

    Some Numbers:
    Barcode CAAAAG/CTTTTG
    DemultiplexSummary: 1,119,171 reads
    Fastq file unaltered from run: 1, 428 reads
    Fastx Barcode Splitter (on undetermined file): 118,031 reads
    Geneious: 574,498 reads

    My questions are:

    1 - why are the different programs giving such disparate results?

    2- Am I misunderstanding the orientation of the barcodes in the reads and thus perhaps searching for them incorrectly? It is my understanding that the "adapter - barcode - read" order should have the barcode as the first 6 bases in the R1 read after adapter trimming (in my example CAAAAG). R2 should not have(?) the barcode - or I should not have to search for a barcode in R2 anyways as I have paired the data? I recovered the reads in Geneious using CTTTTG as that was the index listed in the demultiplexsummary but my barcode as listed in my primer order was CAAAAG so I am concerned that I am misunderstanding a fundamental piece of the puzzle here.

    3 - Most importantly - how do I recover the 1million+ reads?!!?
    BD,

    First things first; assuming that your libraries are standard Illumina design your barcodes are NOT part of R1. In the standard Illumina library design and run configuration the index read is completely separate from R1 or R2. Unless your sequence provider also gave you the index read file (would have something like "I1" in place of R1 or R2 in the file name) then you don't have the information needed to demultiplex your reads.

    Can you provide a copy of the SampleSheet.csv file that was used for the MiSeq run? That will show the indexes actually used by the MiSeq to demultiplex your data. It sounds very likely that the SampleSheet.csv had the indexes entered in the wrong orientation.

    To determine the proper orientation we would need to see an example of your completed adapter sequences, or know what kit was used to construct your libraries.

    Comment


    • #3
      Thank you so much for your reply. I've attached both my sample sheet and my illumina adapter list with the barcodes. I didn't prepare the libraries with a kit but it was a standard prep.
      Could you please explain how the reads and barcodes are oriented? I have searched the literature for this but am clearly misunderstanding something.
      Attached Files

      Comment


      • #4
        Originally posted by biodiverse View Post
        Thank you so much for your reply. I've attached both my sample sheet and my illumina adapter list with the barcodes. I didn't prepare the libraries with a kit but it was a standard prep.
        Could you please explain how the reads and barcodes are oriented? I have searched the literature for this but am clearly misunderstanding something.
        As I suspected your SampleSheet has the indexes written in the wrong orientation. Here is a partial schematic of how the index read would be performed on libraries with the Index 1 primer in your protocol.

        Code:
        Index 1 p7 end primer with i7 index read primer annealed
        
                                          Index (i7) Read Sequencing Primer
                                       <-CACTGACCTCAAGTCTGCACACGAGAAGGCTAG-5’
        5'-CAAGCAGAAGACGGCATACGAGATatcacgGTGACTGGAGTTCAGACGTGT-3'
        
        Index 1 will be read as CGTGAT
        
        (Obviously your actual library molecules would extend out from the 3' end of
        the Index 1 primer, further complementary to the i7 index read sequencing
        primer.)
        To fix your problem you will need to ask your sequencing provider to repeat the original BCL to FastQ conversion with demultiplexing after reverse complementing all of the indexes in the SampleSheet.csv file.

        Comment


        • #5
          It looks like the index sequences in your sample sheet are in the wrong orientation. The demux report shows that the reverse complement of your sample sheet index sequences is what was found in your run.


          Here is a link to a useful document that shows all of the reads used by Illumina sequencers.
          Josh Kinman

          Comment


          • #6
            Originally posted by biodiverse View Post
            Thank you so much for your reply. I've attached both my sample sheet and my illumina adapter list with the barcodes. I didn't prepare the libraries with a kit but it was a standard prep.
            Could you please explain how the reads and barcodes are oriented? I have searched the literature for this but am clearly misunderstanding something.
            As suspected the index sequences in the SampleSheet are in the wrong orientation.

            Code:
            Index1 p7 end primer showing index read (i7) primer annealed 
            
                                              Index (i7) Read Sequencing Primer
                                           <-CACTGACCTCAAGTCTGCACACGAGAAGGCTAG-5’
            5'-CAAGCAGAAGACGGCATACGAGATatcacgGTGACTGGAGTTCAGACGTGT-3'
            
            (Obviously your full library fragment will extend beyond the 3' end of 
            Index1 primer. Truncated for clarity.)
            
            Index1 will be read as CGTGAT
            To fix this problem you will need to correct the SampleSheet.csv file by reverse complementing the indexes. Then repeat the Bcl2Fastq conversion with demultiplexing. I imagine you will need to get your sequencing provider involved since they have the original base call (.bcl) files with the index read data.

            Comment


            • #7
              Thank you so much for your help, I will do this!

              Comment

              Latest Articles

              Collapse

              • seqadmin
                Techniques and Challenges in Conservation Genomics
                by seqadmin



                The field of conservation genomics centers on applying genomics technologies in support of conservation efforts and the preservation of biodiversity. This article features interviews with two researchers who showcase their innovative work and highlight the current state and future of conservation genomics.

                Avian Conservation
                Matthew DeSaix, a recent doctoral graduate from Kristen Ruegg’s lab at The University of Colorado, shared that most of his research...
                03-08-2024, 10:41 AM
              • seqadmin
                The Impact of AI in Genomic Medicine
                by seqadmin



                Artificial intelligence (AI) has evolved from a futuristic vision to a mainstream technology, highlighted by the introduction of tools like OpenAI's ChatGPT and Google's Gemini. In recent years, AI has become increasingly integrated into the field of genomics. This integration has enabled new scientific discoveries while simultaneously raising important ethical questions1. Interviews with two researchers at the center of this intersection provide insightful perspectives into...
                02-26-2024, 02:07 PM

              ad_right_rmr

              Collapse

              News

              Collapse

              Topics Statistics Last Post
              Started by seqadmin, 03-14-2024, 06:13 AM
              0 responses
              32 views
              0 likes
              Last Post seqadmin  
              Started by seqadmin, 03-08-2024, 08:03 AM
              0 responses
              71 views
              0 likes
              Last Post seqadmin  
              Started by seqadmin, 03-07-2024, 08:13 AM
              0 responses
              80 views
              0 likes
              Last Post seqadmin  
              Started by seqadmin, 03-06-2024, 09:51 AM
              0 responses
              68 views
              0 likes
              Last Post seqadmin  
              Working...
              X