Unconfigured Ad

Collapse
X
Collapse
 
  • Page of 1
  • Filter
  • Time
  • Show
Clear All
new posts
Previous template Next
  • rcorbett
    Member
    • Sep 2009
    • 29
    #1

    picard markduplicates on huge files

    Hey folks,
    I'm trying to run markduplicates on some massive files (merged Solid bams), and often 100Gigs of RAM doesn't get the job done.

    Does anyone have a good suggestion for a workaround. I don't want to split into chromosomes because I lose the ability to mark dups that span multiple chromosomes.

    thanks!
    Tags: bam, duplicates, picard
  • malachig
    Senior Member
    • Aug 2010
    • 117
    #2
    Is the BAM file sorted already? If not, is it possible that it is during sorting that picard uses excessive memory? If that's the case, you could, presort the BAM file using SAM tools (which allows max memory usage to be specified) and then use picard to mark duplicates using the 'ASSUME_SORTED' option...

    Comment

    • drio
      Senior Member
      • Oct 2008
      • 323
      #3
      Originally posted by rcorbett View Post
      Hey folks,
      I'm trying to run markduplicates on some massive files (merged Solid bams), and often 100Gigs of RAM doesn't get the job done.

      Does anyone have a good suggestion for a workaround. I don't want to split into chromosomes because I lose the ability to mark dups that span multiple chromosomes.

      thanks!
      Can you show us how your data looks like and the commands you are using?
      -drd

      Comment

      Previous template Next

      Latest Articles

      Collapse
      • SEQadmin2
        Proteomic Platforms: How to Choose the Right Analytical Strategy to Improve Detection and Clinical Applications
        by SEQadmin2


        Proteomics platforms are evolving rapidly, with advances in mass spectrometry and affinity-based approaches expanding what researchers can detect and at what scale. As the field moves toward deeper proteome coverage and clinical applications, scientists face an increasingly complex landscape of tools. This article will explore how researchers are navigating these choices to find the right platform for their work.

        The systematic characterization of the human proteome has        ...
        Yesterday, 11:48 AM
      • SEQadmin2
        Advanced Sequencing Platforms Tackle Neuroscience’s Toughest Genomics Problems
        by SEQadmin2



        Genomics studies in neuroscience face a special challenge due to the brain’s complexity and scarcity of samples. Mapping changes in cell type and state using conventional next-generation sequencing methods remains challenging. Advances in technologies like single-cell sequencing, spatial transcriptomics, and long-read sequencing have opened the door to deeper studies of the brain and diseases like Alzheimer’s, amyotrophic lateral sclerosis (ALS), and schizophrenia.
        ...
        07-09-2026, 11:10 AM
      • SEQadmin2
        Cancer Drug Resistance: The Lingering Barrier to Rising Survival
        by SEQadmin2



        Cancer survival rates have significantly increased in the last few decades in the United States, reaching a combined 70% 5-year survival rate by 2021. Behind this number, there are years of research to find new therapies, drug targets, and early detection methods. But there is one core challenge that keeps slowing down these advances, and it’s about drug resistance.

        There is no single reason why many patients don’t respond to treatment as expected. Cancer is...
        07-08-2026, 05:17 AM
      View All

      ad_right_rmr

      Collapse

      News

      Collapse
      Topics Statistics Last Post
      Single-Cell Atlases Skew Toward European Ancestry, Analysis Finds by SEQadmin2
      Started by SEQadmin2, Yesterday, 11:10 AM
      0 responses
      9 views
      0 reactions
      		 Last Post SEQadmin2
      by SEQadmin2
      Yesterday, 11:10 AM  
      UC San Diego Bioengineers Map Gene Function in Human Stem Cells by SEQadmin2
      Started by SEQadmin2, 07-13-2026, 10:26 AM
      0 responses
      30 views
      0 reactions
      		 Last Post SEQadmin2
      by SEQadmin2
      07-13-2026, 10:26 AM  
      New Analysis Splits Leukemia Into 16 Epigenomic Subgroups by SEQadmin2
      Started by SEQadmin2, 07-09-2026, 10:04 AM
      0 responses
      41 views
      0 reactions
      		 Last Post SEQadmin2
      by SEQadmin2
      07-09-2026, 10:04 AM  
      Genome-Wide CRISPR Screen Uncovers Unlikely Psoriasis Target by SEQadmin2
      Started by SEQadmin2, 07-08-2026, 10:08 AM
      0 responses
      25 views
      0 reactions
      		 Last Post SEQadmin2
      by SEQadmin2
      07-08-2026, 10:08 AM  
      View All
      Working...