The indirect rate-distortion function of a binary i.i.d source

Alon Kipnis, Stefano Rini, Andrea J. Goldsmith

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

The indirect source-coding problem in which a Bernoulli process is compressed in a lossy manner from its noisy observations is considered. These noisy observations are obtained by passing the source sequence through a binary symmetric channel so that the channel crossover probability controls the amount of information available about the source realization at the encoder. We use classic results in rate-distortion theory to compute the rate-distortion function for this model as a solution of an exponential equation. In addition, we derive an upper bound on the rate distortion which has a simple closed-form expression and investigate the coding scheme that attains it. These expressions capture precisely the expected behavior of the rate-distortion function: the noisier the source observations, the smaller the reduction in distortion obtained from increasing the compression rate.

Original languageEnglish (US)
Title of host publicationITW 2015 - 2015 IEEE Information Theory Workshop
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages352-356
Number of pages5
ISBN (Electronic)9781467378529
DOIs
StatePublished - Dec 17 2015
Externally publishedYes
EventIEEE Information Theory Workshop, ITW 2015 - Jeju Island, Korea, Republic of
Duration: Oct 11 2015Oct 15 2015

Publication series

NameITW 2015 - 2015 IEEE Information Theory Workshop

Other

OtherIEEE Information Theory Workshop, ITW 2015
Country/TerritoryKorea, Republic of
CityJeju Island
Period10/11/1510/15/15

All Science Journal Classification (ASJC) codes

  • Information Systems

Keywords

  • Binary source
  • Binary symmetric channel
  • Indirect rate distortion

Cite this