Duality between channel capacity and rate distortion with two-sided state information

Thomas M. Cover, Mung Chiang

Research output: Contribution to journalArticlepeer-review

151 Scopus citations


We show that the duality between channel capacity and data compression is retained when state information is available to the sender, to the receiver, to both, or to neither. We present a unified theory for eight special cases of channel capacity and rate distortion with state information, which also extends existing results to arbitrary pairs of independent and identically distributed (i.i.d.) correlated state information (S 1, S 2) available at the sender and at the receiver, respectively. In particular, the resulting general formula for channel capacity C = max p(u, x|s1) [I(U; S 2, Y) - I(U; S 1)] assumes the same form as the generalized Wyner-Ziv rate distortion function R(D) = min p(u|x,s1)p(x̂|u, s2) [I(U; S 1, X) - I(U; S 2)].

Original languageEnglish (US)
Pages (from-to)1629-1638
Number of pages10
JournalIEEE Transactions on Information Theory
Issue number6
StatePublished - Jun 2002

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences


  • Channel with state information
  • Duality
  • Multiuser information theory
  • Rate distortion with state information
  • Shannon theory
  • Writing on dirty paper


Dive into the research topics of 'Duality between channel capacity and rate distortion with two-sided state information'. Together they form a unique fingerprint.

Cite this