Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • how to filter unaligned duplicate reads

    I've been given a data set (PE-100 reads from both standard and mate-pair libraries) for de novo assembly that's likely to contain a significant fraction of duplicates, based on the number of PCR cycles used to amplify the libraries. I'm aware of tools that filter duplicates based on alignment, but I'd like to do the same for the unaligned reads before attempting assembly (by identifying reads that have identical sequences at both the 5' and 3' ends). Any recommendations?

    Thanks,
    Harold
    Last edited by HESmith; 11-28-2011, 12:06 PM. Reason: typos

  • #2
    That sounds horribly memory intensive, that's probably why almost no one does it that way.

    Comment


    • #3
      I agree but, without a reference genome for alignment, it seems like the only option. A simplistic approach would be to generate hash tables using the first 10 nucleotides from read 1 and read 2 as the key, and keep only one sequence per key. It doesn't account for sequencing errors, but would probably be good enough for my purposes (or at least give me a sense of how much duplication is present). Alternatively, I suppose I could build an assembly from the whole data set, then align to that assembly to identify duplicates.

      Any advice/recommendations/alternative approaches would be welcome.

      Comment


      • #4
        I've developed a naive tool to brute force compare to do some basic removal using hadoop

        Binning Trimmer of Artifacts in Next Gen Sequence - Clean out possible PCR artifacts by searching for like sequence reads via some map reduce - oklasoft/b-tangs

        Comment


        • #5
          In Genomics Workbench, from CLC Bio, you can remove PCR duplicates before alignment

          Comment

          Latest Articles

          Collapse

          • seqadmin
            Strategies for Sequencing Challenging Samples
            by seqadmin


            Despite advancements in sequencing platforms and related sample preparation technologies, certain sample types continue to present significant challenges that can compromise sequencing results. Pedro Echave, Senior Manager of the Global Business Segment at Revvity, explained that the success of a sequencing experiment ultimately depends on the amount and integrity of the nucleic acid template (RNA or DNA) obtained from a sample. “The better the quality of the nucleic acid isolated...
            03-22-2024, 06:39 AM
          • seqadmin
            Techniques and Challenges in Conservation Genomics
            by seqadmin



            The field of conservation genomics centers on applying genomics technologies in support of conservation efforts and the preservation of biodiversity. This article features interviews with two researchers who showcase their innovative work and highlight the current state and future of conservation genomics.

            Avian Conservation
            Matthew DeSaix, a recent doctoral graduate from Kristen Ruegg’s lab at The University of Colorado, shared that most of his research...
            03-08-2024, 10:41 AM

          ad_right_rmr

          Collapse

          News

          Collapse

          Topics Statistics Last Post
          Started by seqadmin, Yesterday, 06:37 PM
          0 responses
          10 views
          0 likes
          Last Post seqadmin  
          Started by seqadmin, Yesterday, 06:07 PM
          0 responses
          9 views
          0 likes
          Last Post seqadmin  
          Started by seqadmin, 03-22-2024, 10:03 AM
          0 responses
          51 views
          0 likes
          Last Post seqadmin  
          Started by seqadmin, 03-21-2024, 07:32 AM
          0 responses
          67 views
          0 likes
          Last Post seqadmin  
          Working...
          X