Can we list all the available ( open source and commercial) parallel (written using MPI / Map Reduce etc) bioinformatics tools. It can include tools that cover both secondary and tertiary analysis i,e from Assembly to Annotation to SNP discover etc. Thank you.
Seqanswers Leaderboard Ad
Collapse
Announcement
Collapse
No announcement yet.
X
-
Originally posted by geschickten View PostCan we list all the available ( open source and commercial) parallel (written using MPI / Map Reduce etc) bioinformatics tools. It can include tools that cover both secondary and tertiary analysis i,e from Assembly to Annotation to SNP discover etc. Thank you.
Map Reduce is a simple model that has been implicit in the design and workflow of parallel processes some time. Most short read aligners can be used in a Map Reduce model, and should be included. For example, you split the reads in to N chunks (usually while converting the Illumina/Solid/ect. input files to FASTQ), you run for each chunk in parallel using an instance of the mapping tool (typically implemented in a multithreaded fashion to take advantage of shared memory), and then merge the results (using maq merge or samtools merge etc.). This is clearly obeying the map reduce model. In fact, programs like BFAST actually come with pipeline scripts to operate in such a model using SGE/PBS schedulers.
Specific computer clusters like hadoop have APIs (say in Java) that help with the map reduce model, but is lacking high performance computing since most code is written in C.
My 1.5 cents (recession).
Comment
-
Yes the MapReduce model in and of itself is nothing new. But the availability of cloud services like AWS EC2 and software like Hadoop have made it that much more accessible to those who aren't C gurus and don't want to deal with the likes of sockets, locks, and other hassles of multithreaded processing. Hadoop can work on much less expensive hardware and can scale a lot more easily (as far as the programmer/end user is concerned). And in the end, if tuned correctly (Hadoop MR is much easier to tune than C code), the ability to scale will outweigh the supposed performance penalty of Java vs. C (which, I might add is a dinosaur of a concept and doesn't hold as true anymore).
Comment
Latest Articles
Collapse
-
by seqadmin
The field of epigenetics has traditionally concentrated more on DNA and how changes like methylation and phosphorylation of histones impact gene expression and regulation. However, our increased understanding of RNA modifications and their importance in cellular processes has led to a rise in epitranscriptomics research. “Epitranscriptomics brings together the concepts of epigenetics and gene expression,” explained Adrien Leger, PhD, Principal Research Scientist...-
Channel: Articles
Yesterday, 07:01 AM -
-
by seqadmin
Proteins are often described as the workhorses of the cell, and identifying their sequences is key to understanding their role in biological processes and disease. Currently, the most common technique used to determine protein sequences is mass spectrometry. While still a valuable tool, mass spectrometry faces several limitations and requires a highly experienced scientist familiar with the equipment to operate it. Additionally, other proteomic methods, like affinity assays, are constrained...-
Channel: Articles
04-04-2024, 04:25 PM -
ad_right_rmr
Collapse
News
Collapse
Topics | Statistics | Last Post | ||
---|---|---|---|---|
Started by seqadmin, 04-11-2024, 12:08 PM
|
0 responses
58 views
0 likes
|
Last Post
by seqadmin
04-11-2024, 12:08 PM
|
||
Started by seqadmin, 04-10-2024, 10:19 PM
|
0 responses
54 views
0 likes
|
Last Post
by seqadmin
04-10-2024, 10:19 PM
|
||
Started by seqadmin, 04-10-2024, 09:21 AM
|
0 responses
45 views
0 likes
|
Last Post
by seqadmin
04-10-2024, 09:21 AM
|
||
Started by seqadmin, 04-04-2024, 09:00 AM
|
0 responses
55 views
0 likes
|
Last Post
by seqadmin
04-04-2024, 09:00 AM
|
Comment