Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • samtools: "sort by name" and fast random access

    I understand that sorting a BAM file, e.g.
    Code:
    samtools sort my_file.bam my_file.sorted
    will allow for faster random access. This makes sense, as viewing reads aligned to a certain region of the genome is much simpler if the reads are ordered by genome coordinates.

    But if you sort a .bam file by read name, e.g.
    Code:
    samtools sort [B]-no[/B] my_file.bam my_file.sorted_by_name
    then how does this allow faster random access?

    I ask because there is no samtools functionality for observing reads by name - the "view" family of commands only accepts genome regions (coordinates).

    How would you random access a .bam file by read name?
    Last edited by cycomatto; 12-21-2011, 07:44 AM.

  • #2
    SAM/BAM files can be sorted by mapping position (normal), which allows efficient access to regions (e.g. chr1 from 1000 to 2000) via the BAI index, or sorted by read name (not commonly used).

    If you want random access to reads by name, the BAM index file (BAI) is no help at all. You would need a separate index mapping read names to offsets. Sorting by read name would be helpful if you have multi-fragment reads (e.g. paired end reads), since then all the fragments would be together on disk so you'd only need one seek. If the reads were not sorted, you'd need to have a lookup table from read name to multiple offsets (one for each read fragment).

    For BAM files you could use the same "virtual offset" approach as BAI uses (essentially a double offset, for a BGZF/GZIP block start, and the within block offset). You might find this blog post interesting about how indexing BGZF files (such as BAM files) can be done:
    BAM files are compressed using a variant of GZIP (GNU ZIP) , called BGZF (Blocked GNU Zip Format). Anyone who has read the SAM/BAM Specifica...

    and http://seqanswers.com/forums/showthread.php?t=15347

    Comment


    • #3
      Originally posted by maubp View Post
      Sorting by read name would be helpful if you have multi-fragment reads (e.g. paired end reads), since then all the fragments would be together on disk so you'd only need one seek.
      This is precisely my situation (given one side of a paired-end read, find its mate).


      I am unclear why the following won't work: FIRST sorting by name, THEN index this name-sorted .bam.

      Doesn't the "index" operation perform this offset for you? So if our .bam is already sorted by name, the the "index" operation will create the virtual offsets you wrote about?

      Comment


      • #4
        Originally posted by cycomatto View Post
        Doesn't the "index" operation perform this offset for you? So if our .bam is already sorted by name, the the "index" operation will create the virtual offsets you wrote about?
        The indexing provided by samtools/picard using the *.bai file ONLY works on BAM files sorted by mapping position.

        I was talking about how as a programmer you can use your own alternative indexing, where you map read names to BAM/BGZF 'virtual offsets'.

        Comment


        • #5
          So then, what is the point of sorting a .bam file by name? Why even include the option in samtools?

          Comment


          • #6
            Originally posted by cycomatto View Post
            So then, what is the point of sorting a .bam file by name? Why even include the option in samtools?
            If you want to process the entire file sequentially and you need to operate on read pairs as a single unit having reads sorted by name (and hence read pairs will be adjacent in the file) greatly reduces complexity. An example of a program which works this way is htseq-count.

            Comment


            • #7
              htseq-count also requires the file to be sorted

              Comment


              • #8
                Originally posted by cycomatto View Post
                So then, what is the point of sorting a .bam file by name? Why even include the option in samtools?
                samtools fixmate

                Comment

                Latest Articles

                Collapse

                • seqadmin
                  Strategies for Sequencing Challenging Samples
                  by seqadmin


                  Despite advancements in sequencing platforms and related sample preparation technologies, certain sample types continue to present significant challenges that can compromise sequencing results. Pedro Echave, Senior Manager of the Global Business Segment at Revvity, explained that the success of a sequencing experiment ultimately depends on the amount and integrity of the nucleic acid template (RNA or DNA) obtained from a sample. “The better the quality of the nucleic acid isolated...
                  03-22-2024, 06:39 AM
                • seqadmin
                  Techniques and Challenges in Conservation Genomics
                  by seqadmin



                  The field of conservation genomics centers on applying genomics technologies in support of conservation efforts and the preservation of biodiversity. This article features interviews with two researchers who showcase their innovative work and highlight the current state and future of conservation genomics.

                  Avian Conservation
                  Matthew DeSaix, a recent doctoral graduate from Kristen Ruegg’s lab at The University of Colorado, shared that most of his research...
                  03-08-2024, 10:41 AM

                ad_right_rmr

                Collapse

                News

                Collapse

                Topics Statistics Last Post
                Started by seqadmin, Yesterday, 06:37 PM
                0 responses
                12 views
                0 likes
                Last Post seqadmin  
                Started by seqadmin, Yesterday, 06:07 PM
                0 responses
                10 views
                0 likes
                Last Post seqadmin  
                Started by seqadmin, 03-22-2024, 10:03 AM
                0 responses
                51 views
                0 likes
                Last Post seqadmin  
                Started by seqadmin, 03-21-2024, 07:32 AM
                0 responses
                68 views
                0 likes
                Last Post seqadmin  
                Working...
                X