TY - JOUR
T1 - Variable-rate channel capacity
AU - Verdú, Sergio
AU - Shamai, Shlomo
N1 - Funding Information:
Manuscript received September 01, 2009; revised February 21, 2010. Current version published May 19, 2010. This work was supported in part by the National Science Foundation under Grants CCF-0635154 and CCF-0728445, in part by the US-Israel Binational Science Foundation, and in part by a Cisco Collaborative Research Initiative Grant. S. Verdú is with the Department of Electrical Engineering, Princeton University, Princeton, NJ 08544 USA (e-mail: [email protected]). S. Shamai (Shitz) is with the Department of Electrical Engineering, Tech-nion—Israel Institute of Technology, Technion City, Haifa 32000, Israel (e-mail: [email protected]). Communicated by I. Kontoyiannis, Associate Editor for Shannon Theory. Color versions of one or more of the figures in this paper are available online at http://ieeexplore.ieee.org. Digital Object Identifier 10.1109/TIT.2010.2046220
PY - 2010/6
Y1 - 2010/6
N2 - This paper introduces the notions of variable-to-fixed and fixed-to-variable channel capacity, without feedback. For channels that satisfy the strong converse, these notions coincide with the conventional Shannon capacity. For channels that do not behave ergodically, the conventional fixed-rate Shannon capacity only depends on least-favorable channel conditions, while the variable-rate capacity notions are able to capture the whole range of channel states and their likelihood, even in the absence of any side information about channel state at the transmitter. Particular emphasis is placed on memoryless channels that are governed by finitely valued states. We show that (single-user) variable-to-fixed channel capacity is intimately connected to the capacity region of broadcast channels with degraded message sets, and we give an expression for the fixed-to-variable capacity.
AB - This paper introduces the notions of variable-to-fixed and fixed-to-variable channel capacity, without feedback. For channels that satisfy the strong converse, these notions coincide with the conventional Shannon capacity. For channels that do not behave ergodically, the conventional fixed-rate Shannon capacity only depends on least-favorable channel conditions, while the variable-rate capacity notions are able to capture the whole range of channel states and their likelihood, even in the absence of any side information about channel state at the transmitter. Particular emphasis is placed on memoryless channels that are governed by finitely valued states. We show that (single-user) variable-to-fixed channel capacity is intimately connected to the capacity region of broadcast channels with degraded message sets, and we give an expression for the fixed-to-variable capacity.
KW - Bayesian modeling
KW - Broadcast channels with degraded message sets
KW - Channel capacity
KW - Fixed-to-variable coding
KW - Fountain codes
KW - Nonergodic channels
KW - Shannon theory
KW - State-dependent channels
KW - Variable-to-fixed coding
UR - http://www.scopus.com/inward/record.url?scp=77955685546&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77955685546&partnerID=8YFLogxK
U2 - 10.1109/TIT.2010.2046220
DO - 10.1109/TIT.2010.2046220
M3 - Article
AN - SCOPUS:77955685546
SN - 0018-9448
VL - 56
SP - 2651
EP - 2667
JO - IEEE Transactions on Information Theory
JF - IEEE Transactions on Information Theory
IS - 6
M1 - 2046220
ER -