TY - JOUR
T1 - Density evolution for asymmetric memoryless channels
AU - Wang, Chih Chun
AU - Kulkarni, Sanjeev R.
AU - Poor, H. Vincent
N1 - Funding Information:
Manuscript received August 15, 2003; revised August 22, 2005. This work was supported in part by the National Science Foundation under Grants CCR-9980590 and CCR-0312413, the Army Research Laboratory Communications Technology Alliance under Contract DAAD19-01-2-0011, the Army Research Office under Contract DAAD19-00-1-0466, and the New Jersey Center for Pervasive Information Technologies. The material in this paper was presented in part at the 3rd International Symposium on Turbo Codes and Related Topics, Brest, France, September 1–5, 2003, and in part at the 39th Annual Conference on Information Sciences and Systems, Baltimore, MD, March 16–18, 2005.
PY - 2005/12
Y1 - 2005/12
N2 - Density evolution (DE) is one of the most powerful analytical tools for Iow-density parity-check (LDPC) codes and graph codes with message passing decoding algorithms. With channel symmetry as one of its fundamental assumptions, density evolution has been widely and successfully applied to different channels, including binary erasure channels (BECs), binary symmetric channels (BSCs), binary additive white Gaussian noise (BiAWGN) channels, etc. This paper generalizes density evolution for asymmetric memoryless channels, which in turn broadens the applications to general memoryless channels, e.g., z-channels, composite white Gaussian noise channels, etc. The central theorem underpinning this generalization is the convergence to perfect projection for any fixed-size supporting tree. A new iterative formula of the same complexity is then presented and the necessary theorems for the performance concentration theorems are developed. Several properties of the new density evolution method are explored, including stability results for general asymmetric memoryless channels. Simulations, code optimizations, and possible new applications suggested by this new density evolution method are also provided. This result is also used to prove the typicality of linear LDPC codes among the coset code ensemble when the minimum check node degree is sufficiently large. It is shown that the convergence to perfect projection is essential to the belief propagation (BP) algorithm even when only symmetric channels are considered. Hence, the proof of the convergence to perfect projection serves also as a completion of the theory of classical density evolution for symmetric memoryless channels.
AB - Density evolution (DE) is one of the most powerful analytical tools for Iow-density parity-check (LDPC) codes and graph codes with message passing decoding algorithms. With channel symmetry as one of its fundamental assumptions, density evolution has been widely and successfully applied to different channels, including binary erasure channels (BECs), binary symmetric channels (BSCs), binary additive white Gaussian noise (BiAWGN) channels, etc. This paper generalizes density evolution for asymmetric memoryless channels, which in turn broadens the applications to general memoryless channels, e.g., z-channels, composite white Gaussian noise channels, etc. The central theorem underpinning this generalization is the convergence to perfect projection for any fixed-size supporting tree. A new iterative formula of the same complexity is then presented and the necessary theorems for the performance concentration theorems are developed. Several properties of the new density evolution method are explored, including stability results for general asymmetric memoryless channels. Simulations, code optimizations, and possible new applications suggested by this new density evolution method are also provided. This result is also used to prove the typicality of linear LDPC codes among the coset code ensemble when the minimum check node degree is sufficiently large. It is shown that the convergence to perfect projection is essential to the belief propagation (BP) algorithm even when only symmetric channels are considered. Hence, the proof of the convergence to perfect projection serves also as a completion of the theory of classical density evolution for symmetric memoryless channels.
KW - Asymmetric channels
KW - Density evolution (DE)
KW - Low-density parity-check (LDPC) codes
KW - Rank of random matrices
KW - Sum-product algorithms
KW - Z-channels
UR - http://www.scopus.com/inward/record.url?scp=29144443942&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=29144443942&partnerID=8YFLogxK
U2 - 10.1109/TIT.2005.858931
DO - 10.1109/TIT.2005.858931
M3 - Article
AN - SCOPUS:29144443942
SN - 0018-9448
VL - 51
SP - 4216
EP - 4236
JO - IRE Professional Group on Information Theory
JF - IRE Professional Group on Information Theory
IS - 12
ER -