Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Desu
    Junior Member
    • Apr 2018
    • 1

    #1

    How to concatenate RNA-seq files generated in differnt lanes

    I have very large RNA-seq files generated in different lanes. I extracted few of the file names as shown below.

    MC9_FNEN_638A_S19_L008_R1_001.fastq.gz
    MC9_FNEN_638A_S19_L008_R2_001.fastq.gz
    MC9_FNEN_638A_S9_L001_R1_001.fastq.gz
    MC9_FNEN_638A_S9_L001_R2_001.fastq.gz
    MC9_FNEN_638A_S9_L002_R1_001.fastq.gz
    MC9_FREN_638A_S9_L002_R2_001.fastq.gz
    MC9_FREN_638A_S9_L006_R1_001.fastq.gz
    MC9_FREN_638A_S9_L006_R2_001.fastq.gz
    MC9_FREN_638A_S9_L008_R1_001.fastq.gz
    MC9_FREN_638A_S9_L008_R2_001.fastq.gz
    MC9_637A_S74_L001_R1_001.fastq.gz
    MC9_ZH_637A_S74_L001_R2_001.fastq.gz
    MC9_ZH_637A_S74_L003_R1_001.fastq.gz
    MC9_ZH_637A_S74_L003_R2_001.fastq.gz
    MC9_ZH_637A_S74_L007_R1_001.fastq.gz
    MC9_ZH_637A_S74_L007_R2_001.fastq.gz
    MC9_ZH_637A_S74_L008_R1_001.fastq.gz
    MC9_ZH_637A_S74_L008_R2_001.fastq.gz
    MC9_ZH_637A_S84_L008_R1_001.fastq.gz
    MC9_ZH_637A_S84_L008_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L001_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L001_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L002_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L002_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L006_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L006_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L007_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L007_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L008_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L008_R2_001.fastq.gz

    I want to concatenate all the sequence generated in different lanes for the forward and reverse read. For example the first 10 lines are sequence file from the same animal and specific tissue (`MC9_FREN`). I want to concatenate all the forward read `XXXXX_R1_001.fastq.gz` that are generated in different lanes and put in the file name `MC9_FREN_R1.fastq.gz` and all reverse reads `XXXX_R2_001.fastq.gz` to `MC9_FREN_R2.fastq.gz`

    cat MC9_FREN_638A_S19_L008_R1_001.fastq.gz MC9_FREN_638A_S9_L001_R1_001.fastq.gz MC9_FREN_638A_S9_L002_R1_001.fastq.gz MC9_FREN_638A_S9_L007_R1_001.fastq.gz MC9_FREN_638A_S9_L008_R1_001.fastq.gz > MC9_FREN_R1.fastq.gz
    cat MC9_FREN_638A_S19_L008_R2_001.fastq.gz MC9_FREN_638A_S9_L001_R2_001.fastq.gz MC9_FREN_638A_S9_L002_R2_001.fastq.gz MC9_FREN_638A_S9_L007_R2_001.fastq.gz MC9_FREN_638A_S9_L008_R2_001.fastq.gz > MC9_FREN_R2.fastq.gz
    cat MC9_ZH_637A_S74_L001_R1_001.fastq.gz MC9_ZH_637A_S74_L003_R1_001.fastq.gz MC9_ZH_637A_S74_L007_R1_001.fastq.gz MC9_ZH_637A_S74_L008_R1_001.fastq.gz MC9_ZH_637A_S84_L008_R1_001.fastq.gz > MC9_ZH_R1.gz
    cat MC9_ZH_637A_S74_L001_R2_001.fastq.gz MC9_ZH_637A_S74_L003_R2_001.fastq.gz MC9_ZH_637A_S74_L007_R2_001.fastq.gz MC9_ZH_637A_S74_L008_R2_001.fastq.gz MC9_ZH_637A_S84_L008_R2_001.fastq.gz > MC9_ZH_R2.gz
    cat DR14_DCRP_479C_S50_L001_R1_001.fastq.gz DR14_DCRP_479C_S50_L002_R1_001.fastq.gz DR14_DCRP_479C_S50_L006_R1_001.fastq.gz DR14_DCRP_479C_S50_L007_R1_001.fastq.gz DR14_DCRP_479C_S50_L008_R1_001.fastq.gz > DR14_DCRP_R1.gz
    cat DR14_DCRP_479C_S50_L001_R2_001.fastq.gz DR14_DCRP_479C_S50_L002_R2_001.fastq.gz DR14_DCRP_479C_S50_L006_R2_001.fastq.gz DR14_DCRP_479C_S50_L007_R2_001.fastq.gz DR14_DCRP_479C_S50_L008_R2_001.fastq.gz > DR14_DCRP_R1.gz
    Last edited by Desu; 04-12-2018, 07:29 AM.
  • GenoMax
    Senior Member
    • Feb 2008
    • 7142

    #2
    It could be best to leave them in pieces while you scan/trim/align them to allow brute-force parallelization. You can then merge the BAM files afterwards to generate a single one per sample.

    Cross-posted (and answered) at Biostars: https://www.biostars.org/p/308606/

    Comment

    Latest Articles

    Collapse

    • SEQadmin2
      Multiomic Liquid Biopsy: What DNA/RNA Panels Reveal That DNA Alone Can’t
      by SEQadmin2



      Tumors contain complex mixtures of cell populations that evolve in response to treatment and host-specific factors. Tissue biopsies provide only static snapshots of a tumor’s state. But what if we could follow that evolution over time using a minimally invasive technique?

      Liquid biopsies can detect tumor-derived material circulating in the bloodstream, providing a way to study treatment response, detect emerging resistance, and discover new biomarkers. Circulating
      ...
      10-14-2026, 09:55 AM
    • SEQadmin2
      New Genomics Technologies Take Aim at Long-Standing Limits
      by SEQadmin2


      Researchers using sequencing and genomics tools often have to make trade-offs. They can choose between speed or scale, short reads or long-range information, or targeted panels or a view of the whole transcriptome. New technologies that have been released this year are built to address those tough choices.

      We asked six companies the same four questions to learn about their latest products. The new technologies bring a lot to the table, including rethinking sequencing
      ...
      09-28-2026, 10:25 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by SEQadmin2, Yesterday, 11:13 AM
    0 responses
    19 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, Yesterday, 10:48 AM
    0 responses
    18 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 10-15-2026, 10:52 AM
    0 responses
    36 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 10-14-2026, 05:39 AM
    0 responses
    42 views
    0 reactions
    Last Post SEQadmin2  
    Working...