Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Optimal balance of threads for alignment & sorting?

    Hello all,

    I was wondering if anyone knows the optimal way to assign threads for alignment and bam decompression/sorting.
    I'm running some alignments and then sorting and de-duping the alignments using a single command like so:

    bwa mem -t 70 ref.fasta reads_R1.fq.gz reads_R2.fq.gz \
    | samblaster \
    | sambamba view -S -f bam /dev/stdin \
    | sambamba sort -t 70 -m 50G -o out.bam /dev/stdin

    There are 72 cores on our server. The read files are large, and this command took about 6hrs to run.

    I then tried it a different way, wherein instead of giving 70 threads to both the alignment and sorting, I gave 50 threads to BWA and 20 to sambamba. That second attempt shaved about 20 minutes off the run (a little over 5.5hrs). This makes me think there is something going on that I don't understand about how the threads are assigned to different processes, and that they must somehow be getting in each other's way.

    I thought about running it with a bunch of different combinations (perhaps with a small subset) to see what the best distribution was, but before doing that it seemed sensible to search for the answer first. Google has not been my friend so far on this, so I though I would see if anyone here knows the optimal way to assign threads for alignment and sorting.

    Thanks,
    A. Koeppel

Latest Articles

Collapse

  • seqadmin
    Strategies for Sequencing Challenging Samples
    by seqadmin


    Despite advancements in sequencing platforms and related sample preparation technologies, certain sample types continue to present significant challenges that can compromise sequencing results. Pedro Echave, Senior Manager of the Global Business Segment at Revvity, explained that the success of a sequencing experiment ultimately depends on the amount and integrity of the nucleic acid template (RNA or DNA) obtained from a sample. “The better the quality of the nucleic acid isolated...
    03-22-2024, 06:39 AM
  • seqadmin
    Techniques and Challenges in Conservation Genomics
    by seqadmin



    The field of conservation genomics centers on applying genomics technologies in support of conservation efforts and the preservation of biodiversity. This article features interviews with two researchers who showcase their innovative work and highlight the current state and future of conservation genomics.

    Avian Conservation
    Matthew DeSaix, a recent doctoral graduate from Kristen Ruegg’s lab at The University of Colorado, shared that most of his research...
    03-08-2024, 10:41 AM

ad_right_rmr

Collapse

News

Collapse

Topics Statistics Last Post
Started by seqadmin, Yesterday, 06:37 PM
0 responses
8 views
0 likes
Last Post seqadmin  
Started by seqadmin, Yesterday, 06:07 PM
0 responses
8 views
0 likes
Last Post seqadmin  
Started by seqadmin, 03-22-2024, 10:03 AM
0 responses
49 views
0 likes
Last Post seqadmin  
Started by seqadmin, 03-21-2024, 07:32 AM
0 responses
67 views
0 likes
Last Post seqadmin  
Working...
X