Finding function: Evaluation methods for functional genomic data

Chad L. Myers, Daniel R. Barrett, Matthew A. Hibbs, Curtis Huttenhower, Olga G. Troyanskaya

Research output: Contribution to journalArticlepeer-review

164 Scopus citations


Background: Accurate evaluation of the quality of genomic or proteomic data and computational methods is vital to our ability to use them for formulating novel biological hypotheses and directing further experiments. There is currently no standard approach to evaluation in functional genomics. Our analysis of existing approaches shows that they are inconsistent and contain substantial functional biases that render the resulting evaluations misleading both quantitatively and qualitatively. These problems make it essentially impossible to compare computational methods or large-scale experimental datasets and also result in conclusions that generalize poorly in most biological applications. Results: We reveal issues with current evaluation methods here and suggest new approaches to evaluation that facilitate accurate and representative characterization of genomic methods and data. Specifically, we describe a functional genomics gold standard based on curation by expert biologists and demonstrate its use as an effective means of evaluation of genomic approaches. Our evaluation framework and gold standard are freely available to the community through our website. Conclusion: Proper methods for evaluating genomic data and computational approaches will determine how much we, as a community, are able to learn from the wealth of available data. We propose one possible solution to this problem here but emphasize that this topic warrants broader community discussion.

Original languageEnglish (US)
Article number187
JournalBMC Genomics
StatePublished - Jul 25 2006

All Science Journal Classification (ASJC) codes

  • Genetics
  • Biotechnology


Dive into the research topics of 'Finding function: Evaluation methods for functional genomic data'. Together they form a unique fingerprint.

Cite this