SEQanswers

Go Back   SEQanswers > Bioinformatics > Open Genomics Engine Project



Similar Threads
Thread Thread Starter Forum Replies Last Post
Complete Genomics Forum and cleaner subforum naming ECO Site Announcements 3 06-21-2011 10:04 AM
PubMed: SeqWare Query Engine: storing and searching sequence data in the cloud. Newsbot! Literature Watch 0 05-28-2011 12:13 PM
Bowtie using Oracle (Sun) Grid Engine (SGE) manuelkohler Bioinformatics 0 10-12-2010 08:15 AM
Genewise program output file discussion edge Bioinformatics 0 04-08-2010 06:27 PM
Towards Forming a Policy on Commerical Posts (OPEN FOR DISCUSSION) ECO Site Feedback/Suggestions 2 09-03-2008 10:14 AM

Reply
 
Thread Tools
Old 05-15-2012, 07:46 AM   #1
ECO
--Site Admin--
 
Location: SF Bay Area, CA, USA

Join Date: Oct 2007
Posts: 1,352
Default Welcome to the Open Genomics Engine Discussion Forum

Hi all,

I'm excited to announce that SEQanswers will act as the official discussion host for the Open Genomics Engine project. See the official announcement below:

Quote:
The Open Genomics Engine (OpenGE) was developed at Virginia Bioinformatics Institute and Virginia Tech and funded by the NVIDIA Foundation. OpenGE is designed for analyzing and interpreting high-throughput sequencing data. It is freely available to the research community to enable other investigators to build upon the tools and collaboratively advance the fields of genomics and cancer biology.

David Mittelman, associate professor at the Virginia Bioinformatics Institute and the Department of Biological Sciences at Virginia Tech, will be the project leader for OpenGE. His laboratory will maintain the official OpenGE distribution, as well as ongoing research and development for the project. The bioinformatics lead will be Gareth Highnam and the software development lead will be Lee Baker, both from VBI. Contact Dr. Mittelman and his team to learn more about the effort, contribute, or provide feedback on the project.

The official OpenGE discussion community is hosted by Eric Olivares at SEQanswers. SEQanswers is the largest online genomics community and is a free and open knowledge-sharing resource for interdisciplinary discussion covering experimental and computational aspects of sequencing and sequencing analysis. SEQanswers has more than 4,000 active members, including developers of many popular genome analysis tools.

OpenGE is the first project to be funded under Compute the Cure, an initiative of the NVIDIA Foundation to help accelerate cancer researcher in the search for a cure.
As always, feedback and input are welcome.

-=Eric
ECO is offline   Reply With Quote
Old 05-15-2012, 06:02 PM   #2
gringer
David Eccles (gringer)
 
Location: Wellington, New Zealand

Join Date: May 2011
Posts: 799
Default

Will this be a frontend to manage a number of different FOSS HTS analysis packages with one program, or a rebuilt chariot for HTS analysis?
gringer is offline   Reply With Quote
Old 05-15-2012, 08:00 PM   #3
adaptivegenome
Super Moderator
 
Location: US

Join Date: Nov 2009
Posts: 437
Default

Hi gringer,

Certainly one aspect of OpenGE will be the management of analysis pipelines composed of existing tools. Much like the recently released bpipe project, the aim would be to incorporate existing tools into workflows. We want to eventually build a web-based GUI (in development right now) that allows for the dynamic creation of workflows (currently this is implemented at the command line) and we would like it to feature things like: versioning of tools, progress tracking, recovery and restarting from errors, etc.

Rewriting everyone's code is inefficient and unnecessary, but OpenGE also will feature modifications of existing code from projects like bamtools. We have implemented a multithreaded BAM compression method, a multithread combined merge-sort, and some other low-level tools for operating on BAM files. I know Heng Li has begun introducing some of this into samtools and I believe Nils Homer may be working on this as well. I would love to see how our code stacks up since a secondary goal of the project is to accelerate the analysis of genomes.

One nice thing about the project is that we will have funding to continue development of the GUI as well as optimization and addition of other tools to the software. I am hoping that via SEQanswers we can get direction from the community on prioritizing what to do next. Furthermore we hope to write adapters/plugins for existing tools and to encourage others to join in the development, etc.

The project is completely open source and will be hosted on GitHub. We are hoping that the combination of fast code and a easy to use package manager/workflow GUI will put all this analysis in the hands everyone...

Sorry for the long post, but hopefully that sort answers your question?
adaptivegenome is offline   Reply With Quote
Old 05-15-2012, 08:24 PM   #4
gringer
David Eccles (gringer)
 
Location: Wellington, New Zealand

Join Date: May 2011
Posts: 799
Default

Quote:
Sorry for the long post, but hopefully that sort answers your question?
Yes, thank you. The description on the website (and posted here) was a bit vague. Your explanation makes me feel a bit more positive about the project.
gringer is offline   Reply With Quote
Old 05-15-2012, 10:51 PM   #5
adaptivegenome
Super Moderator
 
Location: US

Join Date: Nov 2009
Posts: 437
Default

Thanks for the feedback. I'll see if we can get the website updated a bit.
adaptivegenome is offline   Reply With Quote
Old 06-01-2012, 08:50 AM   #6
adaptivegenome
Super Moderator
 
Location: US

Join Date: Nov 2009
Posts: 437
Default

Although the project officially goes live on Monday, June 4th, the code is available on github now.

The main code featuring multithreaded processing of BAM files is located here:
https://github.com/adaptivegenome/openge

Binaries are here:
https://github.com/adaptivegenome/openge/downloads


The preliminary release of a bpipe-compatible workflow system is located:
https://github.com/adaptivegenome/OGE-Workflows

The main code is based on bamtools and so for those that are familiar with samtools or bamtools, it should be easy to start using right away. Please feel free to submit comments/suggestions via the github site (under Issues) or discuss here in this forum. We would be grateful to hear of bugs or simply feedback on speed increases with different input data.

Last edited by adaptivegenome; 06-02-2012 at 04:33 AM.
adaptivegenome is offline   Reply With Quote
Old 06-09-2012, 10:23 AM   #7
rezaf_2000
Junior Member
 
Location: Urbana, IL

Join Date: Jun 2012
Posts: 1
Default

So, what is the role of NVIDIA in Open GE?
rezaf_2000 is offline   Reply With Quote
Old 06-09-2012, 11:06 AM   #8
adaptivegenome
Super Moderator
 
Location: US

Join Date: Nov 2009
Posts: 437
Default

Quote:
Originally Posted by rezaf_2000 View Post
So, what is the role of NVIDIA in Open GE?
NVIDIA Corporation is not involved, however the NVIDIA Foundation (philanthropic non-profit) funded the pilot project.

The foundation will continue to fund us in the short-term but we will need to recruit additional sources of extramural funding from the NIH, NSF, etc. for the long-term sustainment of the project.
adaptivegenome is offline   Reply With Quote
Old 04-29-2013, 07:22 AM   #9
BobFreemanMA
Junior Member
 
Location: Boston, MA

Join Date: Jan 2011
Posts: 8
Default And this is different from Galaxy in what ways???

Quote:
Originally Posted by adaptivegenome View Post
Hi gringer,

Certainly one aspect of OpenGE will be the management of analysis pipelines composed of existing tools. Much like the recently released bpipe project, the aim would be to incorporate existing tools into workflows. We want to eventually build a web-based GUI (in development right now) that allows for the dynamic creation of workflows (currently this is implemented at the command line) and we would like it to feature things like: versioning of tools, progress tracking, recovery and restarting from errors, etc.

Rewriting everyone's code is inefficient and unnecessary, but OpenGE also will feature modifications of existing code from projects like bamtools. We have implemented a multithreaded BAM compression method, a multithread combined merge-sort, and some other low-level tools for operating on BAM files. I know Heng Li has begun introducing some of this into samtools and I believe Nils Homer may be working on this as well. I would love to see how our code stacks up since a secondary goal of the project is to accelerate the analysis of genomes.

One nice thing about the project is that we will have funding to continue development of the GUI as well as optimization and addition of other tools to the software. I am hoping that via SEQanswers we can get direction from the community on prioritizing what to do next. Furthermore we hope to write adapters/plugins for existing tools and to encourage others to join in the development, etc.

The project is completely open source and will be hosted on GitHub. We are hoping that the combination of fast code and a easy to use package manager/workflow GUI will put all this analysis in the hands everyone...

Sorry for the long post, but hopefully that sort answers your question?
This seems very exciting and promising, but I hope that you can tell me how this project is different from Galaxy. And it seems to have a significant advantage in terms of release time, users, development, etc.

Tx,
Bob
BobFreemanMA is offline   Reply With Quote
Old 04-29-2013, 01:56 PM   #10
adaptivegenome
Super Moderator
 
Location: US

Join Date: Nov 2009
Posts: 437
Default

Quote:
Originally Posted by BobFreemanMA View Post
This seems very exciting and promising, but I hope that you can tell me how this project is different from Galaxy. And it seems to have a significant advantage in terms of release time, users, development, etc.

Tx,
Bob
It has been a year since I posted that message and since then we decided against developing a GUI. We have functionality that allows you to plug-in external tools into OpenGE (bpipe style) and this is great for simple command-line based workflows. It is definitely not intended to be a replacement for Galaxy, which is one the best workflow managers around.

The focus of OpenGE was to speed up and optimize certain steps of the genome analysis pipeline. I think we achieved that. The code is not 100% bug-free but it has been a continuous work in progress
adaptivegenome is offline   Reply With Quote
Old 04-30-2013, 07:36 AM   #11
BobFreemanMA
Junior Member
 
Location: Boston, MA

Join Date: Jan 2011
Posts: 8
Default

Quote:
Originally Posted by adaptivegenome View Post
It has been a year since I posted that message and since then we decided against developing a GUI. We have functionality that allows you to plug-in external tools into OpenGE (bpipe style) and this is great for simple command-line based workflows. It is definitely not intended to be a replacement for Galaxy, which is one the best workflow managers around.

The focus of OpenGE was to speed up and optimize certain steps of the genome analysis pipeline. I think we achieved that. The code is not 100% bug-free but it has been a continuous work in progress
Sounds great. Thanks!
BobFreemanMA is offline   Reply With Quote
Old 04-14-2015, 10:06 AM   #12
dhfx
Junior Member
 
Location: Austin, TX USA

Join Date: Apr 2015
Posts: 3
Default

What is the status of OpenGE? Is development continuing?
dhfx is offline   Reply With Quote
Old 11-26-2015, 09:56 PM   #13
gsgs
Senior Member
 
Location: germany

Join Date: Oct 2009
Posts: 140
Default

Quote:
Originally Posted by ECO View Post
Hi all,

I'm excited to announce that SEQanswers will act as the official discussion host for the Open Genomics Engine project. See the official announcement below:



As always, feedback and input are welcome.

-=Eric

in what language are the programs written, what compiler is needed,
what operation system, do the programs work from command line,
can they be joined in batch files, is there a simple example of some
such program, and the typical size of a data-file which it handles
gsgs is offline   Reply With Quote
Old 07-22-2016, 06:41 AM   #14
zee
NGS specialist
 
Location: Malaysia

Join Date: Apr 2008
Posts: 249
Default

This post seems pretty out-of-date.
zee is offline   Reply With Quote
Old 08-17-2016, 12:03 AM   #15
sklages
Senior Member
 
Location: Berlin, DE

Join Date: May 2008
Posts: 619
Default

Yepp, .. project development has been discontinued..

Latest news is:
Quote:
Download OpenGE version 0.4
May 23, 2013
OpenGE 0.4 features improved speed and stability…
sklages is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off




All times are GMT -8. The time now is 03:52 AM.


Powered by vBulletin® Version 3.8.9
Copyright ©2000 - 2017, vBulletin Solutions, Inc.
Single Sign On provided by vBSSO