Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • How to concatenate RNA-seq files generated in differnt lanes

    I have very large RNA-seq files generated in different lanes. I extracted few of the file names as shown below.

    MC9_FNEN_638A_S19_L008_R1_001.fastq.gz
    MC9_FNEN_638A_S19_L008_R2_001.fastq.gz
    MC9_FNEN_638A_S9_L001_R1_001.fastq.gz
    MC9_FNEN_638A_S9_L001_R2_001.fastq.gz
    MC9_FNEN_638A_S9_L002_R1_001.fastq.gz
    MC9_FREN_638A_S9_L002_R2_001.fastq.gz
    MC9_FREN_638A_S9_L006_R1_001.fastq.gz
    MC9_FREN_638A_S9_L006_R2_001.fastq.gz
    MC9_FREN_638A_S9_L008_R1_001.fastq.gz
    MC9_FREN_638A_S9_L008_R2_001.fastq.gz
    MC9_637A_S74_L001_R1_001.fastq.gz
    MC9_ZH_637A_S74_L001_R2_001.fastq.gz
    MC9_ZH_637A_S74_L003_R1_001.fastq.gz
    MC9_ZH_637A_S74_L003_R2_001.fastq.gz
    MC9_ZH_637A_S74_L007_R1_001.fastq.gz
    MC9_ZH_637A_S74_L007_R2_001.fastq.gz
    MC9_ZH_637A_S74_L008_R1_001.fastq.gz
    MC9_ZH_637A_S74_L008_R2_001.fastq.gz
    MC9_ZH_637A_S84_L008_R1_001.fastq.gz
    MC9_ZH_637A_S84_L008_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L001_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L001_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L002_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L002_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L006_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L006_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L007_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L007_R2_001.fastq.gz
    DR14_DCRP_479C_S50_L008_R1_001.fastq.gz
    DR14_DCRP_479C_S50_L008_R2_001.fastq.gz

    I want to concatenate all the sequence generated in different lanes for the forward and reverse read. For example the first 10 lines are sequence file from the same animal and specific tissue (`MC9_FREN`). I want to concatenate all the forward read `XXXXX_R1_001.fastq.gz` that are generated in different lanes and put in the file name `MC9_FREN_R1.fastq.gz` and all reverse reads `XXXX_R2_001.fastq.gz` to `MC9_FREN_R2.fastq.gz`

    cat MC9_FREN_638A_S19_L008_R1_001.fastq.gz MC9_FREN_638A_S9_L001_R1_001.fastq.gz MC9_FREN_638A_S9_L002_R1_001.fastq.gz MC9_FREN_638A_S9_L007_R1_001.fastq.gz MC9_FREN_638A_S9_L008_R1_001.fastq.gz > MC9_FREN_R1.fastq.gz
    cat MC9_FREN_638A_S19_L008_R2_001.fastq.gz MC9_FREN_638A_S9_L001_R2_001.fastq.gz MC9_FREN_638A_S9_L002_R2_001.fastq.gz MC9_FREN_638A_S9_L007_R2_001.fastq.gz MC9_FREN_638A_S9_L008_R2_001.fastq.gz > MC9_FREN_R2.fastq.gz
    cat MC9_ZH_637A_S74_L001_R1_001.fastq.gz MC9_ZH_637A_S74_L003_R1_001.fastq.gz MC9_ZH_637A_S74_L007_R1_001.fastq.gz MC9_ZH_637A_S74_L008_R1_001.fastq.gz MC9_ZH_637A_S84_L008_R1_001.fastq.gz > MC9_ZH_R1.gz
    cat MC9_ZH_637A_S74_L001_R2_001.fastq.gz MC9_ZH_637A_S74_L003_R2_001.fastq.gz MC9_ZH_637A_S74_L007_R2_001.fastq.gz MC9_ZH_637A_S74_L008_R2_001.fastq.gz MC9_ZH_637A_S84_L008_R2_001.fastq.gz > MC9_ZH_R2.gz
    cat DR14_DCRP_479C_S50_L001_R1_001.fastq.gz DR14_DCRP_479C_S50_L002_R1_001.fastq.gz DR14_DCRP_479C_S50_L006_R1_001.fastq.gz DR14_DCRP_479C_S50_L007_R1_001.fastq.gz DR14_DCRP_479C_S50_L008_R1_001.fastq.gz > DR14_DCRP_R1.gz
    cat DR14_DCRP_479C_S50_L001_R2_001.fastq.gz DR14_DCRP_479C_S50_L002_R2_001.fastq.gz DR14_DCRP_479C_S50_L006_R2_001.fastq.gz DR14_DCRP_479C_S50_L007_R2_001.fastq.gz DR14_DCRP_479C_S50_L008_R2_001.fastq.gz > DR14_DCRP_R1.gz
    Last edited by Desu; 04-12-2018, 07:29 AM.

  • #2
    It could be best to leave them in pieces while you scan/trim/align them to allow brute-force parallelization. You can then merge the BAM files afterwards to generate a single one per sample.

    Cross-posted (and answered) at Biostars: https://www.biostars.org/p/308606/

    Comment

    Latest Articles

    Collapse

    • seqadmin
      Current Approaches to Protein Sequencing
      by seqadmin


      Proteins are often described as the workhorses of the cell, and identifying their sequences is key to understanding their role in biological processes and disease. Currently, the most common technique used to determine protein sequences is mass spectrometry. While still a valuable tool, mass spectrometry faces several limitations and requires a highly experienced scientist familiar with the equipment to operate it. Additionally, other proteomic methods, like affinity assays, are constrained...
      04-04-2024, 04:25 PM
    • seqadmin
      Strategies for Sequencing Challenging Samples
      by seqadmin


      Despite advancements in sequencing platforms and related sample preparation technologies, certain sample types continue to present significant challenges that can compromise sequencing results. Pedro Echave, Senior Manager of the Global Business Segment at Revvity, explained that the success of a sequencing experiment ultimately depends on the amount and integrity of the nucleic acid template (RNA or DNA) obtained from a sample. “The better the quality of the nucleic acid isolated...
      03-22-2024, 06:39 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by seqadmin, 04-11-2024, 12:08 PM
    0 responses
    25 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 04-10-2024, 10:19 PM
    0 responses
    29 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 04-10-2024, 09:21 AM
    0 responses
    24 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 04-04-2024, 09:00 AM
    0 responses
    52 views
    0 likes
    Last Post seqadmin  
    Working...
    X