Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • Layla
    Member
    • Sep 2008
    • 58

    maq merge limit

    Hi,

    Is there a limit to the number of map files that can be merged using
    ./maq mapmerge? If so, is there a way to overcome this for short paired end reads?

    Cheers

    L
  • nilshomer
    Nils Homer
    • Nov 2008
    • 1283

    #2
    Originally posted by Layla View Post
    Hi,

    Is there a limit to the number of map files that can be merged using
    ./maq mapmerge? If so, is there a way to overcome this for short paired end reads?

    Cheers

    L
    I would assume the limit is the maximum number of arguments generally a command line tool can accept (argv & argc stuff), which is in the thousands. Anyhow, if you have millions of .map files, I would ask why? If you truly have millions of .map files you could just do the merge step of merge sort whereby you group .map files into pairs of .map files and merge each pair, rinse and repeat. Again, how many .map files do you have?

    Nils

    Comment

    • Layla
      Member
      • Sep 2008
      • 58

      #3
      Thank you for your reply
      I have 10 patients each generate 15 .map files

      I split them into pairs of 1 million (total 2 million reads) to speed up maq alignment.

      L

      Comment

      • nilshomer
        Nils Homer
        • Nov 2008
        • 1283

        #4
        Originally posted by Layla View Post
        Thank you for your reply
        I have 10 patients each generate 15 .map files

        I split them into pairs of 1 million (total 2 million reads) to speed up maq alignment.

        L
        15 .map files no problem.

        Comment

        • Layla
          Member
          • Sep 2008
          • 58

          #5
          Great, but would you know of any way to speed maq up? Even chunks of 2 million take a few days as I am running the .map command simultaneously. If not, not a problem.

          Cheers
          L

          Comment

          • der_eiskern
            Member
            • Jul 2009
            • 46

            #6
            i've merged 41 map files 'lickedy split'

            Comment

            • der_eiskern
              Member
              • Jul 2009
              • 46

              #7
              Layla what's your machine set up? i can map 40 sets of 1 million reads in 5.5 hours using a single processor on a machine with 16 Gb RAM. are you running it simultaneously on multiple processors?

              Comment

              • henry
                Member
                • Sep 2009
                • 36

                #8
                Originally posted by Layla View Post
                Hi,

                Is there a limit to the number of map files that can be merged using
                ./maq mapmerge? If so, is there a way to overcome this for short paired end reads?

                Cheers

                L
                it's no problem to merge 15 map files for maq.
                BWA adopted burrows-wheeler transform algorithm and many tricks to accelerate processing speed. BWA is also written by the author who coded maq. You can try BWA. it should be faster.
                Last edited by henry; 09-05-2009, 01:06 AM.

                Comment

                Latest Articles

                Collapse

                • SEQadmin2
                  Nine Things a Sample Prep Scientist Thinks About Before Sequencing
                  by SEQadmin2


                  I’m not a sequencing expert. I’m a purification scientist who uses NGS to evaluate workflows my group develops. With this perspective, we think about the sample first and the NGS workflow second. The sequencer is an exceptionally honest reporter, but it can only report on what you give it, so whether you get clean, interpretable data from an NGS workflow is largely determined before you begin.


                  Here are nine questions we think about, in roughly the order they matter, before...
                  Today, 07:11 AM
                • SEQadmin2
                  From Collection to Sequencing: Why Sample Preparation and Preservation Define Sequencing Data
                  by SEQadmin2


                  Data variability is still an issue in sequencing technologies despite the advances in reproducibility and accuracy of these platforms. But the problem does not originate in the sequencing itself, but in the previous steps, before the sample reaches the sequencer.


                  The first step is collection, followed by preservation and sample preparation for analysis. Most scientists overlook those steps, but not being careful might just be skewing the experiment’s results.
                  ...
                  06-02-2026, 10:05 AM
                • SEQadmin2
                  Single-Cell Sequencing at an Inflection Point: Early Impacts of New Platforms and Emerging Trends
                  by SEQadmin2


                  With the launch of new single-cell sequencing platforms in 2026, the field stands at an exciting inflection point. This article surveys the most impactful advances in the field and discusses how they’re reshaping research in cancer, immunology, and beyond.


                  Introduction

                  Single-cell sequencing technologies have undergone remarkable advances over the past decade, transitioning from low-throughput experimental approaches to highly scalable platforms capable of...
                  05-22-2026, 06:42 AM

                ad_right_rmr

                Collapse

                News

                Collapse

                Topics Statistics Last Post
                Started by SEQadmin2, Yesterday, 06:09 AM
                0 responses
                16 views
                0 reactions
                Last Post SEQadmin2  
                Started by SEQadmin2, 06-09-2026, 11:58 AM
                0 responses
                37 views
                0 reactions
                Last Post SEQadmin2  
                Started by SEQadmin2, 06-05-2026, 10:09 AM
                0 responses
                42 views
                0 reactions
                Last Post SEQadmin2  
                Started by SEQadmin2, 06-04-2026, 08:59 AM
                0 responses
                49 views
                0 reactions
                Last Post SEQadmin2  
                Working...