Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • Jazzy
    Junior Member
    • Jun 2014
    • 2

    qsub memory allocation

    Hey,

    I intend to write a shell which automatically submit jobs with qsub. One idea is that it'll be better if the shell assigns how much memory each job needs to each qsub command. However, I am not quite sure how much each job needs. Is there anyone out there who knows how to approximate the memory needed?
  • rhinoceros
    Senior Member
    • Apr 2013
    • 372

    #2
    Is there anyone out there who knows how to approximate the memory needed?
    X times Y times Z

    Where X is the estimated single-thread memory usage of your task, Y is the number or threads, and Z is how memory usage scales with threads.

    For example:

    Task takes 4GB
    Two threads
    No thread-effect

    4GB x 2 x 0.5 (two threads share the RAM) = 4GB

    Task takes 4GB
    Two threads
    Each thread takes full RAM

    4GB X 2 x 1 = 8GB


    A clear answer to a clear question.
    Last edited by rhinoceros; 06-10-2014, 03:34 AM.
    savetherhino.org

    Comment

    • Jazzy
      Junior Member
      • Jun 2014
      • 2

      #3
      Originally posted by rhinoceros View Post
      X times Y times Z

      Where X is the estimated single-thread memory usage of your task, Y is the number or threads, and Z is how memory usage scales with threads.

      For example:

      Task takes 4GB
      Two threads
      No thread-effect

      4GB x 2 x 0.5 (two threads share the RAM) = 4GB

      Task takes 4GB
      Two threads
      Each thread takes full RAM

      4GB X 2 x 1 = 8GB


      A clear answer to a clear question.
      hey,rhinoceros, thanks for your answer! and yes I believe you've given a very clear one.

      Comment

      Latest Articles

      Collapse

      • SEQadmin2
        From Collection to Sequencing: Why Sample Preparation and Preservation Define Sequencing Data
        by SEQadmin2


        Data variability is still an issue in sequencing technologies despite the advances in reproducibility and accuracy of these platforms. But the problem does not originate in the sequencing itself, but in the previous steps, before the sample reaches the sequencer.


        The first step is collection, followed by preservation and sample preparation for analysis. Most scientists overlook those steps, but not being careful might just be skewing the experiment’s results.
        ...
        Yesterday, 10:05 AM
      • SEQadmin2
        Single-Cell Sequencing at an Inflection Point: Early Impacts of New Platforms and Emerging Trends
        by SEQadmin2


        With the launch of new single-cell sequencing platforms in 2026, the field stands at an exciting inflection point. This article surveys the most impactful advances in the field and discusses how they’re reshaping research in cancer, immunology, and beyond.


        Introduction

        Single-cell sequencing technologies have undergone remarkable advances over the past decade, transitioning from low-throughput experimental approaches to highly scalable platforms capable of...
        05-22-2026, 06:42 AM
      • SEQadmin2
        Environmental Genomics in the Age of NGS: From Microbes to Conservation Strategies
        by SEQadmin2

        Studying ecosystems means dealing with complex, multi-species communities that are hard to observe at scale. This complexity, however, hides many important questions to be answered, from how biogeochemical cycles work and how climate change can affect species distribution to how conservation strategies can work best.


        Genomics, particularly since the expansion of NGS, has transformed ecosystem ecology. By sequencing environmental DNA, we can now assess biodiversity without direct...
        05-06-2026, 09:04 AM

      ad_right_rmr

      Collapse

      News

      Collapse

      Topics Statistics Last Post
      Started by SEQadmin2, Yesterday, 12:03 PM
      0 responses
      19 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, Yesterday, 11:40 AM
      0 responses
      14 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 05-28-2026, 11:40 AM
      0 responses
      29 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 05-26-2026, 10:12 AM
      0 responses
      31 views
      0 reactions
      Last Post SEQadmin2  
      Working...