Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • TopHat (Tuxedo Suite) - AWS vs Local

    Hello All
    Sorry this one's a bit long
    Have come here after some testing !!

    I am trying to run Tuxedo suite for RNASeq Analysis on AWS

    Post alignment using Tophat, I have recorded significant difference in size of "accepted_hits.bam" between runs on AWS (Amazon Web Services) and Local System

    Details
    Paired end FastQs
    Size - after Adapter and quality thresholding - 7 gigs (3.5 X 2)
    Human Sample

    AWS Instance
    15 cores - of - m4.16xlarge (64 cores/256 RAM)
    Time ~45 min
    Out put accepted_hits.bam ~100mb

    Local Server
    15 cores - of - 36 cores/256 RAM
    Time ~52 min
    Out put accepted_hits.bam ~1.2GB

    Questions
    Why such significant difference? reasons?

    One thread I found, which was somewhat related


    As suggested in the above thread, I have tried running tophat, with same parameters and input files,
    on 1, 5, 10, 15, 20, 30 and 64 cores on local servers
    on 30 and 64 cores on AWS

    Interestingly, the size of "accepted_hits.bam" remained same (1.2 gb) till I reached 30 cores on local server (with specs mentioned above), and reduced (~120 mb) on 64 cores.
    On AWS, as said above, 30 and (later) 64 are giving out ~100 mb of accepted_hits.bam

    any input, suggestions and comments are welcome
    thank you for your time !!

  • #2
    Sounds like a bug to me... maybe you should try a different version of Tophat. The number of cores should not affect the size of the output bam more than a tiny amount.

    Alternatively, you could try BBMap; it's faster than Tophat and produces correct output for any number of cores

    Comment

    Latest Articles

    Collapse

    • seqadmin
      Recent Advances in Sequencing Analysis Tools
      by seqadmin


      The sequencing world is rapidly changing due to declining costs, enhanced accuracies, and the advent of newer, cutting-edge instruments. Equally important to these developments are improvements in sequencing analysis, a process that converts vast amounts of raw data into a comprehensible and meaningful form. This complex task requires expertise and the right analysis tools. In this article, we highlight the progress and innovation in sequencing analysis by reviewing several of the...
      Today, 07:48 AM
    • seqadmin
      Essential Discoveries and Tools in Epitranscriptomics
      by seqadmin




      The field of epigenetics has traditionally concentrated more on DNA and how changes like methylation and phosphorylation of histones impact gene expression and regulation. However, our increased understanding of RNA modifications and their importance in cellular processes has led to a rise in epitranscriptomics research. “Epitranscriptomics brings together the concepts of epigenetics and gene expression,” explained Adrien Leger, PhD, Principal Research Scientist...
      04-22-2024, 07:01 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by seqadmin, Today, 07:17 AM
    0 responses
    11 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 05-02-2024, 08:06 AM
    0 responses
    19 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 04-30-2024, 12:17 PM
    0 responses
    20 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 04-29-2024, 10:49 AM
    0 responses
    28 views
    0 likes
    Last Post seqadmin  
    Working...
    X