SEQanswers

Go Back   SEQanswers > Bioinformatics > Bioinformatics

Similar Threads
Thread Thread Starter Forum Replies Last Post
Optimal high performance computer spec for NGS data analysis ezy85 De novo discovery 8 02-05-2013 12:59 PM
Softwares/Pipelines for ChIP Seq Analysis ayushraman Bioinformatics 0 09-16-2011 05:37 PM
illumina smallRNA adapter sequence for downstram analysis + miRNA analysis steps ndeshpan Bioinformatics 2 06-14-2011 10:44 PM
PubMed: HCV Transmission Bottlenecks Analyzed by Deep Sequencing. Newsbot! Literature Watch 0 04-09-2010 03:00 AM
What are today's computational bottlenecks? GerryB Bioinformatics 8 05-04-2009 01:25 AM

Reply
 
Thread Tools
Old 11-04-2011, 06:14 AM   #1
DanielChubb
Junior Member
 
Location: UK

Join Date: Nov 2011
Posts: 2
Question Performance bottlenecks in sequence analysis pipelines

Hi,

Has anyone who has used the GATK pipeline and/or sequence alignment tools such as BWA and stampy have a feel for what the worst bottlenecks are in performance? As I only have access to the one system that I am running it on (a SGI ICE cluster with network attached storage) it is hard to get a feel for what might improve it.

I/O seems to be a big issue in most of the processes I run and I wonder whether running on a machine with less cores but direct attached fast (raided/striped) storage would be faster.

Anyway, it's a bit of an unfocussed question, I just wonder if anyone had any real world experience of trying to run these processes in different scenarios and what they have found works best.

Thanks a lot

Dan
DanielChubb is offline   Reply With Quote
Old 11-04-2011, 08:34 AM   #2
westerman
Rick Westerman
 
Location: Purdue University, Indiana, USA

Join Date: Jun 2008
Posts: 1,104
Default

I/O. Get yourself a fast storage. And for many pipelines large memory. Having multiple cores is nice but not critical. There are many pipelines which slow down to a one-core crawl as they read/write a file. Also some programs don't scale up very well. Just today on the Trinity mailing list someone was commenting that parts of it run faster on one-core instead of 10-cores. One of the developers agreed with that statement.
westerman is offline   Reply With Quote
Reply

Tags
gatk alignment pipeline

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off




All times are GMT -8. The time now is 02:36 AM.


Powered by vBulletin® Version 3.8.9
Copyright ©2000 - 2021, vBulletin Solutions, Inc.
Single Sign On provided by vBSSO