A view of information-estimation relations in Gaussian networks

Alex Dytso; Ronit Bustin; H. Vincent Poor; Shlomo Shamai

doi:10.3390/e19080409

A view of information-estimation relations in Gaussian networks

Alex Dytso, Ronit Bustin, H. Vincent Poor, Shlomo Shamai

Research output: Contribution to journal › Review article › peer-review

12 Scopus citations

Abstract

Relations between estimation and information measures have received considerable attention from the information theory community. One of the most notable such relationships is the I-MMSE identity of Guo, Shamai and Verdú that connects the mutual information and the minimum mean square error (MMSE). This paper reviews several applications of the I-MMSE relationship to information theoretic problems arising in connection with multi-user channel coding. The goal of this paper is to review the different techniques used on such problems, as well as to emphasize the added-value obtained from the information-estimation point of view.

Original language	English (US)
Article number	409
Journal	Entropy
Volume	19
Issue number	8
DOIs	https://doi.org/10.3390/e19080409
State	Published - Aug 1 2017

All Science Journal Classification (ASJC) codes

Information Systems
Electrical and Electronic Engineering
General Physics and Astronomy
Mathematical Physics
Physics and Astronomy (miscellaneous)

Keywords

Estimation theory
I-MMSE
Network information theory

Access to Document

10.3390/e19080409

Cite this

@article{08d7591e01d84c529265867f066913bd,

title = "A view of information-estimation relations in Gaussian networks",

abstract = "Relations between estimation and information measures have received considerable attention from the information theory community. One of the most notable such relationships is the I-MMSE identity of Guo, Shamai and Verd{\'u} that connects the mutual information and the minimum mean square error (MMSE). This paper reviews several applications of the I-MMSE relationship to information theoretic problems arising in connection with multi-user channel coding. The goal of this paper is to review the different techniques used on such problems, as well as to emphasize the added-value obtained from the information-estimation point of view.",

keywords = "Estimation theory, I-MMSE, Network information theory",

author = "Alex Dytso and Ronit Bustin and Poor, {H. Vincent} and Shlomo Shamai",

note = "Publisher Copyright: {\textcopyright} 2017 by the authors.",

year = "2017",

month = aug,

day = "1",

doi = "10.3390/e19080409",

language = "English (US)",

volume = "19",

journal = "Entropy",

issn = "1099-4300",

publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",

number = "8",

}

TY - JOUR

T1 - A view of information-estimation relations in Gaussian networks

AU - Dytso, Alex

AU - Bustin, Ronit

AU - Poor, H. Vincent

AU - Shamai, Shlomo

PY - 2017/8/1

Y1 - 2017/8/1

N2 - Relations between estimation and information measures have received considerable attention from the information theory community. One of the most notable such relationships is the I-MMSE identity of Guo, Shamai and Verdú that connects the mutual information and the minimum mean square error (MMSE). This paper reviews several applications of the I-MMSE relationship to information theoretic problems arising in connection with multi-user channel coding. The goal of this paper is to review the different techniques used on such problems, as well as to emphasize the added-value obtained from the information-estimation point of view.

AB - Relations between estimation and information measures have received considerable attention from the information theory community. One of the most notable such relationships is the I-MMSE identity of Guo, Shamai and Verdú that connects the mutual information and the minimum mean square error (MMSE). This paper reviews several applications of the I-MMSE relationship to information theoretic problems arising in connection with multi-user channel coding. The goal of this paper is to review the different techniques used on such problems, as well as to emphasize the added-value obtained from the information-estimation point of view.

KW - Estimation theory

KW - I-MMSE

KW - Network information theory

UR - http://www.scopus.com/inward/record.url?scp=85028516837&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85028516837&partnerID=8YFLogxK

U2 - 10.3390/e19080409

DO - 10.3390/e19080409

M3 - Review article

AN - SCOPUS:85028516837

SN - 1099-4300

VL - 19

JO - Entropy

JF - Entropy

IS - 8

M1 - 409

ER -

A view of information-estimation relations in Gaussian networks

Abstract

All Science Journal Classification (ASJC) codes

Keywords

Access to Document

Other files and links

Fingerprint

Cite this