Worst additive noise: An information-estimation view

Ronit Bustin, H. Vincent Poor, Shlomo Shamai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

The "worst additive noise" problem is considered. The problem refers to an additive channel in which the input is known to some extent. It is further assumed that the noise consists of an additive Gaussian component and an additive component of arbitrary distribution. The question is: what is the distribution over the additive noise that will minimize the mutual information between the input and the output? Two settings for this problem are considered. In the first setting a Gaussian input with a given covariance matrix is considered and it is shown that the problem can be handled in the framework of the Guo, Shamai and Verdú I-MMSE relationship. This framework gives a simple derivation of Diggavi and Cover's result, that under a covariance constraint the "worst additive noise" distribution is Gaussian, meaning that Gaussian noise minimizes the input-output mutual information given that the input is Gaussian. The I-MMSE framework also shows that given that the input is Gaussian distributed, for any constraint on the distribution of the noise, which does not prohibit a Gaussian distribution, the "worst" distribution is a Gaussian distribution complying with the constraint. In the second setting it is assumed that the input contains a codeword from an optimal point-to-point codebook (i.e., it achieves capacity) and it is shown, for a subset of SNRs, that the minimum mutual information is obtained when the additive signal is Gaussian-like up to a given SNR.

Original languageEnglish (US)
Title of host publication2014 IEEE 28th Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479959877
DOIs
StatePublished - Jan 1 2014
Event2014 28th IEEE Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014 - Eilat, Israel
Duration: Dec 3 2014Dec 5 2014

Publication series

Name2014 IEEE 28th Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014

Other

Other2014 28th IEEE Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014
CountryIsrael
CityEilat
Period12/3/1412/5/14

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Worst additive noise: An information-estimation view'. Together they form a unique fingerprint.

  • Cite this

    Bustin, R., Poor, H. V., & Shamai, S. (2014). Worst additive noise: An information-estimation view. In 2014 IEEE 28th Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014 [7005759] (2014 IEEE 28th Convention of Electrical and Electronics Engineers in Israel, IEEEI 2014). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EEEI.2014.7005759