The interplay between information and estimation measures

Dongning Guo, Shlomo Shamai, Sergio Verdú

Research output: Contribution to journalArticlepeer-review

31 Scopus citations

Abstract

This monograph surveys the interactions between information measures and estimation measures as well as their applications. The emphasis is on formulas that express the major information measures, such as entropy, mutual information and relative entropy in terms of the minimum mean square error achievable when estimating random variables contaminated by Gaussian noise. These relationships lead to wide applications ranging from a universal relationship in continuoustime nonlinear filtering to optimal power allocation in communication systems, to the simplified proofs of important results in information theory such as the entropy power inequality and converses in multiuser information theory.

Original languageEnglish (US)
Pages (from-to)243-429
Number of pages187
JournalFoundations and Trends in Signal Processing
Volume6
Issue number4
DOIs
StatePublished - Dec 1 2012

All Science Journal Classification (ASJC) codes

  • Signal Processing

Fingerprint Dive into the research topics of 'The interplay between information and estimation measures'. Together they form a unique fingerprint.

Cite this