Operational duality between lossy compression and channel coding

Ankit Gupta, Sergio Verdú

Research output: Contribution to journalArticlepeer-review

18 Scopus citations


We explore the duality between lossy compression and channel coding in the operational sense: whether a capacity-achieving encoder-decoder sequence achieves the rate-distortion function of the dual problem when the channel decoder [encoder] is the source compressor [decompressor, resp.], and vice versa. We show that, if used as a lossy compressor, the maximum-likelihood channel decoder of a randomly chosen capacity-achieving codebook achieves the rate-distortion function almost surely. However, operational duality does not hold for every capacity achieving encoder-decoder sequence, or rate-distortion achieving compressor-decompressor sequence. We show that there exist optimal channel coding [lossy compression] schemes, which fail when used for the dual lossy compression [channel coding resp.] problem.

Original languageEnglish (US)
Article number5773027
Pages (from-to)3171-3179
Number of pages9
JournalIEEE Transactions on Information Theory
Issue number6
StatePublished - Jun 2011

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences


  • Channel coding with cost constraints
  • discrete memoryless channels
  • discrete memoryless sources
  • lossy data compression
  • rate-distortion theory
  • source-channel coding duality


Dive into the research topics of 'Operational duality between lossy compression and channel coding'. Together they form a unique fingerprint.

Cite this