SEQanswers

Go Back   SEQanswers > Bioinformatics > Bioinformatics



Similar Threads
Thread Thread Starter Forum Replies Last Post
Can I use cuffdiff to compare 2 groups? twotwo Bioinformatics 2 06-24-2013 05:52 AM
Different RPKM values in same dataset using Cufflinks or Cuffdiff (v1.3.0) hlwright Bioinformatics 3 11-09-2012 03:51 AM
sample RNAseq data to compare cuffdiff and DESeq performance Sun-SEQ Bioinformatics 0 08-15-2012 09:13 PM
DESeq without biological replicates (dataset: Marioni et al.) Andrea Apolloni Bioinformatics 3 01-13-2012 04:58 AM
compare expression? cuffcompare or cuffdiff vebaev RNA Sequencing 6 12-21-2010 09:59 PM

Reply
 
Thread Tools
Old 09-06-2013, 04:15 AM   #1
narges
Member
 
Location: Finland

Join Date: Aug 2012
Posts: 29
Default Spike in dataset to compare DESeq vs cuffdiff

Hi all,

I wanted to ask if you have any idea to be fair as much as possible when comparing two RNA-seq analysis methods like DESeq and cuffdiff. I know one ideal option is using spikein datasets, or alternatively a simulated dataset but then I have no clue about if there are any publicly available spikein dataset for RNA-seq.
Any help or idea would be appreciated.
narges is offline   Reply With Quote
Old 09-07-2013, 03:47 PM   #2
Wolfgang Huber
Senior Member
 
Location: Heidelberg, Germany

Join Date: Aug 2009
Posts: 109
Default

Dear Narges

simulation is great to check how well your software does (or approximates) what your theory says, but it does not help with the question whether your theory (or: model) agrees with reality.

As for real data, two criteria that seem to make sense are specificity (how many or few false positives do you find) and sensitivity (how many true positives do you find). As for specificity, this is in fact quite easy with real data, just do the same comparison that you would like to do, but in a "mock" fashion with all samples actually being biological replicates. For sensitivity, you need a "ground truth" of truly differentially expressed genes. These may be hard to come by - but you can use prior biological knowledge, independent experiments, etc. Also, this ground truth does not need to be strictly true for the purpose of method ranking, it is sufficient if it is enriched for truth, and the false genes in there are random (the concept of 'pseudo-ROC' by Richard Bourgon).

Best wishes
Wolfgang
__________________
Wolfgang Huber
EMBL
Wolfgang Huber is offline   Reply With Quote
Reply

Tags
cuffdiff, deseq, spike in control ngs

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off




All times are GMT -8. The time now is 09:10 AM.


Powered by vBulletin® Version 3.8.9
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
Single Sign On provided by vBSSO