Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • parser needed for bcl2fastq2 output

    I'm looking for a parser to compile basic stats from the various html/xml/text output files from NextSeq runs. Looking for a text file to archive with fastq files that includes sample name, sample ID, indexes, total clusters per sample not per lane since NextSeq lanes are not independent. Thanks.

  • #2
    Take a look at MultiQC if you want to look at many runs.

    Following is true for local bcl2fastq analysis. I am not familiar with BaseSpace but I suppose a similar structure can be found there as well.

    Otherwise the index.html file found in (FCID/Unaligned/Reports/html) directory has all the stats or if you prefer a standalone file then (FCID/Unaligned/Reports/html/FC_BARCODE/all/all/all/laneBarcode.html).

    JSON format results are in (FCID/Unaligned/Stats/Json.stats).
    Last edited by GenoMax; 03-05-2018, 11:22 AM.

    Comment


    • #3
      Thanks GenoMax. We are running our NextSeq standalone.

      The html file displays the metrics per lane per sample...I'd like to have the information for each sample combined into one row, e.g. Lane 1 Sample A, Lane 2 Sample A, Lane 3 Sample A, Lane 4 Sample A -> Sample A.

      If you know of an html to csv or json to csv script I could handle this in Excel.

      Comment


      • #4
        While there appear to be many (?) online tools following may be safer.

        1. Download Atom programmers editor here.
        2. Find "Settings" tab after installing Atom and click on +Install.
        3. Search for a package called "json-converter" and install it.
        4. Download and open Stats.json file in Atom.
        5. Use Packages menu drop down, find "Json Converter" and select "Json to csv".
        6. Write the converted data out to file and then do what you need to in Excel.

        Comment


        • #5
          As a side-note, when running bcl2fastq you can use the option "--no-lane-splitting" to create fastqs that don't separate your samples by lane. This is useful to avoid having to combine them downstream.

          Comment


          • #6
            Originally posted by lac302 View Post
            I'm looking for a parser to compile basic stats from the various html/xml/text output files from NextSeq runs. Looking for a text file to archive with fastq files that includes sample name, sample ID, indexes, total clusters per sample not per lane since NextSeq lanes are not independent. Thanks.
            Hello lac302,

            I have attached a perl script I use for this purpose, however when dealing with NextSeq run data the stats are still divided by lane. The script reads the DemultiplexingStats.xml and ConversionStats.xml files within the Stats/ directory created by bcl2fastq2. It requires Perl Modules Getopt::Long and XML::LibXML. It has one mandatory input, the path to the Stats/ directory and one optional argument for parsing data from single end runs.

            Code:
            # parseBcl2FastqStatsXml.pl [-s] -i <path>/Stats/ > output.txt
            
            The argument for -i must end in /Stats/
            -s is optional for single read runs
            The output is a tab delimited text file with relevant per sample, per lane stats.
            Attached Files
            Last edited by kmcarr; 03-06-2018, 09:06 AM.

            Comment


            • #7
              Guess what?...You can copy and paste from html to excel.

              I was making it harder than it needed to be.

              Comment


              • #8
                @kmcarr, thanks for that useful parser! One quick question: is there any way to sum each line instead of showing them separately?

                Thanks!

                Comment


                • #9
                  Originally posted by jgarces View Post
                  @kmcarr, thanks for that useful parser! One quick question: is there any way to sum each line instead of showing them separately?

                  Thanks!
                  By "sum each line" do you mean the total output per lane? If so then that information is provided directly in the HiSeq output summary before running BCL2FastqQ.

                  Comment


                  • #10
                    Thanks for you reply, @kmcarr. Our sequencing were performed in a different lab and we haven't the BCL and this kind of run information... but at the end, with your parser and a bit of R, I was able to extract the information I wanted.

                    Thanks again!

                    Comment

                    Latest Articles

                    Collapse

                    • seqadmin
                      Strategies for Sequencing Challenging Samples
                      by seqadmin


                      Despite advancements in sequencing platforms and related sample preparation technologies, certain sample types continue to present significant challenges that can compromise sequencing results. Pedro Echave, Senior Manager of the Global Business Segment at Revvity, explained that the success of a sequencing experiment ultimately depends on the amount and integrity of the nucleic acid template (RNA or DNA) obtained from a sample. “The better the quality of the nucleic acid isolated...
                      03-22-2024, 06:39 AM
                    • seqadmin
                      Techniques and Challenges in Conservation Genomics
                      by seqadmin



                      The field of conservation genomics centers on applying genomics technologies in support of conservation efforts and the preservation of biodiversity. This article features interviews with two researchers who showcase their innovative work and highlight the current state and future of conservation genomics.

                      Avian Conservation
                      Matthew DeSaix, a recent doctoral graduate from Kristen Ruegg’s lab at The University of Colorado, shared that most of his research...
                      03-08-2024, 10:41 AM

                    ad_right_rmr

                    Collapse

                    News

                    Collapse

                    Topics Statistics Last Post
                    Started by seqadmin, Yesterday, 06:37 PM
                    0 responses
                    10 views
                    0 likes
                    Last Post seqadmin  
                    Started by seqadmin, Yesterday, 06:07 PM
                    0 responses
                    10 views
                    0 likes
                    Last Post seqadmin  
                    Started by seqadmin, 03-22-2024, 10:03 AM
                    0 responses
                    51 views
                    0 likes
                    Last Post seqadmin  
                    Started by seqadmin, 03-21-2024, 07:32 AM
                    0 responses
                    67 views
                    0 likes
                    Last Post seqadmin  
                    Working...
                    X