Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • 1k genomes and VCF: slow processing of individual genome

    Hi all,
    I'm currently having troubles extracting a single genome's VCF file from the 1000 genomes repository. Theoretically using tabix and vcftools it's working, but it just appears to be incredibly slow. For instance I've started loading ca. 14 hours ago and currently have only got VCF files for 4 chromosomes. This is my code:

    for i in 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 22 X
    do
    tabix -h ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/release/20110521/ALL.chr${i}.phase1_release_v3.20101123.snps_indels_svs.genotypes.vcf.gz ${i} | vcf-subset -a -e -c HG00096 | bgzip -c > HG00096/HG00096_chr${i}.vcf.gz
    done

    I'd be happy for any advise on this. I've also as a test downloaded a full chromosome for all samples VCF file and tried if this accelerated the process, but haven't noticed a real difference.

    Thanks
    Simon

  • #2
    Your script is looks OK. Try to use multiple machines to speed up the process.

    Comment


    • #3
      Hi TiborNagy,
      Thanks for your quick reply. This is good to know - in this case I will indeed move on to the cluster...

      Best
      Simon

      Comment

      Latest Articles

      Collapse

      • seqadmin
        Strategies for Sequencing Challenging Samples
        by seqadmin


        Despite advancements in sequencing platforms and related sample preparation technologies, certain sample types continue to present significant challenges that can compromise sequencing results. Pedro Echave, Senior Manager of the Global Business Segment at Revvity, explained that the success of a sequencing experiment ultimately depends on the amount and integrity of the nucleic acid template (RNA or DNA) obtained from a sample. “The better the quality of the nucleic acid isolated...
        03-22-2024, 06:39 AM
      • seqadmin
        Techniques and Challenges in Conservation Genomics
        by seqadmin



        The field of conservation genomics centers on applying genomics technologies in support of conservation efforts and the preservation of biodiversity. This article features interviews with two researchers who showcase their innovative work and highlight the current state and future of conservation genomics.

        Avian Conservation
        Matthew DeSaix, a recent doctoral graduate from Kristen Ruegg’s lab at The University of Colorado, shared that most of his research...
        03-08-2024, 10:41 AM

      ad_right_rmr

      Collapse

      News

      Collapse

      Topics Statistics Last Post
      Started by seqadmin, 03-27-2024, 06:37 PM
      0 responses
      13 views
      0 likes
      Last Post seqadmin  
      Started by seqadmin, 03-27-2024, 06:07 PM
      0 responses
      11 views
      0 likes
      Last Post seqadmin  
      Started by seqadmin, 03-22-2024, 10:03 AM
      0 responses
      53 views
      0 likes
      Last Post seqadmin  
      Started by seqadmin, 03-21-2024, 07:32 AM
      0 responses
      69 views
      0 likes
      Last Post seqadmin  
      Working...
      X