TY - JOUR
T1 - Duality between channel capacity and rate distortion with two-sided state information
AU - Cover, Thomas M.
AU - Chiang, Mung
N1 - Funding Information:
Manuscript received June 13, 2001; revised December 18, 2001. The work of T. M. Cover was supported in part by the NSF under Grant CCR-9973134 and MURI DAAD-19-99-1-0215. The work of M. Chiang was supported by the Hertz Foundation Graduate Fellowship and the Stanford Graduate Fellowship. The material in this paper was presented in part at the IEEE International Symposium of Information Theory and its Applications, HI, November 2000, and at the IEEE International Symposium of Information Theory, Washington, DC, June 2001.
PY - 2002/6
Y1 - 2002/6
N2 - We show that the duality between channel capacity and data compression is retained when state information is available to the sender, to the receiver, to both, or to neither. We present a unified theory for eight special cases of channel capacity and rate distortion with state information, which also extends existing results to arbitrary pairs of independent and identically distributed (i.i.d.) correlated state information (S 1, S 2) available at the sender and at the receiver, respectively. In particular, the resulting general formula for channel capacity C = max p(u, x|s1) [I(U; S 2, Y) - I(U; S 1)] assumes the same form as the generalized Wyner-Ziv rate distortion function R(D) = min p(u|x,s1)p(x̂|u, s2) [I(U; S 1, X) - I(U; S 2)].
AB - We show that the duality between channel capacity and data compression is retained when state information is available to the sender, to the receiver, to both, or to neither. We present a unified theory for eight special cases of channel capacity and rate distortion with state information, which also extends existing results to arbitrary pairs of independent and identically distributed (i.i.d.) correlated state information (S 1, S 2) available at the sender and at the receiver, respectively. In particular, the resulting general formula for channel capacity C = max p(u, x|s1) [I(U; S 2, Y) - I(U; S 1)] assumes the same form as the generalized Wyner-Ziv rate distortion function R(D) = min p(u|x,s1)p(x̂|u, s2) [I(U; S 1, X) - I(U; S 2)].
KW - Channel with state information
KW - Duality
KW - Multiuser information theory
KW - Rate distortion with state information
KW - Shannon theory
KW - Writing on dirty paper
UR - http://www.scopus.com/inward/record.url?scp=0036611985&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0036611985&partnerID=8YFLogxK
U2 - 10.1109/TIT.2002.1003843
DO - 10.1109/TIT.2002.1003843
M3 - Article
AN - SCOPUS:0036611985
SN - 0018-9448
VL - 48
SP - 1629
EP - 1638
JO - IEEE Transactions on Information Theory
JF - IEEE Transactions on Information Theory
IS - 6
ER -