Estimating Entropy

William Bialek, Jonathan Miller

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Entropy estimation, which plays a central role in the analysis of biological data is discussed. Small improvements in estimates of relative entropy can yield significant rewards in the quality of sequence alignments. Estimation must be carried out in a regime where the possibilities are not exhausted by the data. It is found that within a Bayesian approach, the best possible estimates based on the data can be made by using a uniform entropic prior- one that reflects minimal a priori assumptions about the entropy.

Original languageEnglish (US)
Title of host publicationProceedings of the 6th Joint Conference on Information Sciences, JCIS 2002
EditorsJ.H. Caulfield, S.H. Chen, H.D. Cheng, R. Duro, J.H. Caufield, S.H. Chen, H.D. Cheng, R. Duro, V. Honavar
Pages1281
Number of pages1
StatePublished - 2002
EventProceedings of the 6th Joint Conference on Information Sciences, JCIS 2002 - Research Triange Park, NC, United States
Duration: Mar 8 2002Mar 13 2002

Publication series

NameProceedings of the Joint Conference on Information Sciences
Volume6

Other

OtherProceedings of the 6th Joint Conference on Information Sciences, JCIS 2002
Country/TerritoryUnited States
CityResearch Triange Park, NC
Period3/8/023/13/02

All Science Journal Classification (ASJC) codes

  • General Computer Science

Fingerprint

Dive into the research topics of 'Estimating Entropy'. Together they form a unique fingerprint.

Cite this