Operational duality between lossy compression and channel coding: Channel decoders as lossy compressors

Ankit Gupta, Sergio Verdu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

We explore the duality between lossy compression and channel coding in the operational sense: whether a capacityachieving encoder-decoder sequence achieves the rate distortion function of the dual problem when the channel decoder [encoder) is the source compressor [decompressor, resp). We show that, if used as a lossy compressor, the maximum-likelihood channel decoder of a randomly chosen capacity-achieving codebook achieves the rate-distortion function almost surely. However, operational duality does not hold for every capacity achieving encoderdecoder sequence. We show that there exist optimal channel coding schemes, which operate far from the rate-distortion function when used for the dual lossy compression problem. Index Terms: Channel coding with cost constraints, discrete memoryless sources, lossy data compression, rate-distortion theory,source-channel coding duality.

Original languageEnglish (US)
Title of host publicationInformation Theory and Applications Workshop, ITA 2009
Pages119-123
Number of pages5
DOIs
StatePublished - Sep 25 2009
EventInformation Theory and Applications Workshop, ITA 2009 - San Diego, CA, United States
Duration: Feb 8 2009Feb 13 2009

Publication series

NameInformation Theory and Applications Workshop, ITA 2009

Other

OtherInformation Theory and Applications Workshop, ITA 2009
CountryUnited States
CitySan Diego, CA
Period2/8/092/13/09

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Information Systems

Fingerprint Dive into the research topics of 'Operational duality between lossy compression and channel coding: Channel decoders as lossy compressors'. Together they form a unique fingerprint.

Cite this