The interplay between information and estimation measures

Dongning Guo, Shlomo Shamai, Sergio Verdú

Research output: Contribution to journalArticlepeer-review

44 Scopus citations


This monograph surveys the interactions between information measures and estimation measures as well as their applications. The emphasis is on formulas that express the major information measures, such as entropy, mutual information and relative entropy in terms of the minimum mean square error achievable when estimating random variables contaminated by Gaussian noise. These relationships lead to wide applications ranging from a universal relationship in continuoustime nonlinear filtering to optimal power allocation in communication systems, to the simplified proofs of important results in information theory such as the entropy power inequality and converses in multiuser information theory.

Original languageEnglish (US)
Pages (from-to)243-429
Number of pages187
JournalFoundations and Trends in Signal Processing
Issue number4
StatePublished - 2012

All Science Journal Classification (ASJC) codes

  • Signal Processing


Dive into the research topics of 'The interplay between information and estimation measures'. Together they form a unique fingerprint.

Cite this