Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Desu
    Junior Member
    • Apr 2018
    • 1

    #1

    How to concatenate RNA-seq files generated in differnt lanes

    I have very large RNA-seq files generated in different lanes. I extracted few of the file names as shown below.

    MC9_FNEN_638A_S19_L008_R1_001.fastq.gz
    MC9_FNEN_638A_S19_L008_R2_001.fastq.gz
    MC9_FNEN_638A_S9_L001_R1_001.fastq.gz
    MC9_FNEN_638A_S9_L001_R2_001.fastq.gz
    MC9_FNEN_638A_S9_L002_R1_001.fastq.gz
    MC9_FREN_638A_S9_L002_R2_001.fastq.gz
    MC9_FREN_638A_S9_L006_R1_001.fastq.gz
    MC9_FREN_638A_S9_L006_R2_001.fastq.gz
    MC9_FREN_638A_S9_L008_R1_001.fastq.gz
    MC9_FREN_638A_S9_L008_R2_001.fastq.gz
    MC9_637A_S74_L001_R1_001.fastq.gz
    MC9_ZH_637A_S74_L001_R2_001.fastq.gz
    MC9_ZH_637A_S74_L003_R1_001.fastq.gz
    MC9_ZH_637A_S74_L003_R2_001.fastq.gz
    MC9_ZH_637A_S74_L007_R1_001.fastq.gz
    MC9_ZH_637A_S74_L007_R2_001.fastq.gz
    MC9_ZH_637A_S74_L008_R1_001.fastq.gz
    MC9_ZH_637A_S74_L008_R2_001.fastq.gz
    MC9_ZH_637A_S84_L008_R1_001.fastq.gz
    MC9_ZH_637A_S84_L008_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L001_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L001_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L002_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L002_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L006_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L006_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L007_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L007_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L008_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L008_R2_001.fastq.gz

    I want to concatenate all the sequence generated in different lanes for the forward and reverse read. For example the first 10 lines are sequence file from the same animal and specific tissue (`MC9_FREN`). I want to concatenate all the forward read `XXXXX_R1_001.fastq.gz` that are generated in different lanes and put in the file name `MC9_FREN_R1.fastq.gz` and all reverse reads `XXXX_R2_001.fastq.gz` to `MC9_FREN_R2.fastq.gz`

    cat MC9_FREN_638A_S19_L008_R1_001.fastq.gz MC9_FREN_638A_S9_L001_R1_001.fastq.gz MC9_FREN_638A_S9_L002_R1_001.fastq.gz MC9_FREN_638A_S9_L007_R1_001.fastq.gz MC9_FREN_638A_S9_L008_R1_001.fastq.gz > MC9_FREN_R1.fastq.gz
    cat MC9_FREN_638A_S19_L008_R2_001.fastq.gz MC9_FREN_638A_S9_L001_R2_001.fastq.gz MC9_FREN_638A_S9_L002_R2_001.fastq.gz MC9_FREN_638A_S9_L007_R2_001.fastq.gz MC9_FREN_638A_S9_L008_R2_001.fastq.gz > MC9_FREN_R2.fastq.gz
    cat MC9_ZH_637A_S74_L001_R1_001.fastq.gz MC9_ZH_637A_S74_L003_R1_001.fastq.gz MC9_ZH_637A_S74_L007_R1_001.fastq.gz MC9_ZH_637A_S74_L008_R1_001.fastq.gz MC9_ZH_637A_S84_L008_R1_001.fastq.gz > MC9_ZH_R1.gz
    cat MC9_ZH_637A_S74_L001_R2_001.fastq.gz MC9_ZH_637A_S74_L003_R2_001.fastq.gz MC9_ZH_637A_S74_L007_R2_001.fastq.gz MC9_ZH_637A_S74_L008_R2_001.fastq.gz MC9_ZH_637A_S84_L008_R2_001.fastq.gz > MC9_ZH_R2.gz
    cat DR14_DCRP_479C_S50_L001_R1_001.fastq.gz DR14_DCRP_479C_S50_L002_R1_001.fastq.gz DR14_DCRP_479C_S50_L006_R1_001.fastq.gz DR14_DCRP_479C_S50_L007_R1_001.fastq.gz DR14_DCRP_479C_S50_L008_R1_001.fastq.gz > DR14_DCRP_R1.gz
    cat DR14_DCRP_479C_S50_L001_R2_001.fastq.gz DR14_DCRP_479C_S50_L002_R2_001.fastq.gz DR14_DCRP_479C_S50_L006_R2_001.fastq.gz DR14_DCRP_479C_S50_L007_R2_001.fastq.gz DR14_DCRP_479C_S50_L008_R2_001.fastq.gz > DR14_DCRP_R1.gz
    Last edited by Desu; 04-12-2018, 07:29 AM.
  • GenoMax
    Senior Member
    • Feb 2008
    • 7142

    #2
    It could be best to leave them in pieces while you scan/trim/align them to allow brute-force parallelization. You can then merge the BAM files afterwards to generate a single one per sample.

    Cross-posted (and answered) at Biostars: https://www.biostars.org/p/308606/

    Comment

    Latest Articles

    Collapse

    • SEQadmin2
      Beyond CRISPR/Cas9: Understand, Choose, and Use the Right Genome Editing Tool
      by SEQadmin2



      CRISPR/Cas9 sparked the gene editing revolution for both research and therapeutics.1 But this system still showed severe issues that limited its applications. The most prominent were the heavy reliance on PAM sequences, delivery limitations, double-stranded breaks that prompt unintended edits and cell death, and editing inefficiency (both in targeting and in knock-in reliability).

      Despite this, “CRISPR helped turn genome editing from a specialized technique into
      ...
      07-31-2026, 11:01 AM
    • SEQadmin2
      Proteomic Platforms: How to Choose the Right Analytical Strategy to Improve Detection and Clinical Applications
      by SEQadmin2


      Proteomics platforms are evolving rapidly, with advances in mass spectrometry and affinity-based approaches expanding what researchers can detect and at what scale. As the field moves toward deeper proteome coverage and clinical applications, scientists face an increasingly complex landscape of tools. This article will explore how researchers are navigating these choices to find the right platform for their work.

      The systematic characterization of the human proteome has
      ...
      07-20-2026, 11:48 AM
    • SEQadmin2
      Advanced Sequencing Platforms Tackle Neuroscience’s Toughest Genomics Problems
      by SEQadmin2



      Genomics studies in neuroscience face a special challenge due to the brain’s complexity and scarcity of samples. Mapping changes in cell type and state using conventional next-generation sequencing methods remains challenging. Advances in technologies like single-cell sequencing, spatial transcriptomics, and long-read sequencing have opened the door to deeper studies of the brain and diseases like Alzheimer’s, amyotrophic lateral sclerosis (ALS), and schizophrenia.
      ...
      07-09-2026, 11:10 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by SEQadmin2, Today, 07:41 AM
    0 responses
    9 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 08-03-2026, 10:13 AM
    0 responses
    25 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 07-31-2026, 02:55 AM
    0 responses
    38 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 07-24-2026, 12:17 PM
    0 responses
    25 views
    0 reactions
    Last Post SEQadmin2  
    Working...