TY - GEN

T1 - A coding theorem for f-separable distortion measures

AU - Shkel, Yanina

AU - Verdú, Sergio

PY - 2017/3/27

Y1 - 2017/3/27

N2 - Rate-distortion theory is a branch of information theory that provides theoretical foundation for lossy data compression. In this setting, the decompressed data need not match original data exactly; however, it must be reconstructed with a prescribed fidelity, which is modeled by a distortion measure. An ubiquitous assumption in rate-distortion literature is that such distortion measures are separable: that is, the distortion measure can be expressed as an arithmetic average of single-letter distortions. Such set up gives nice theoretical results at the expense of a very restrictive model. Separable distortion measures are linear functions of single-letter distortions; real-world distortion measures rarely have such nice structure. In this work we relax the separability assumption and propose f-separable distortion measures, which are well suited to model non-linear penalties. We prove a rate-distortion coding theorem for stationary ergodic sources with f-separable distortion measures, and provide some illustrative examples of the resulting rate-distortion functions.

AB - Rate-distortion theory is a branch of information theory that provides theoretical foundation for lossy data compression. In this setting, the decompressed data need not match original data exactly; however, it must be reconstructed with a prescribed fidelity, which is modeled by a distortion measure. An ubiquitous assumption in rate-distortion literature is that such distortion measures are separable: that is, the distortion measure can be expressed as an arithmetic average of single-letter distortions. Such set up gives nice theoretical results at the expense of a very restrictive model. Separable distortion measures are linear functions of single-letter distortions; real-world distortion measures rarely have such nice structure. In this work we relax the separability assumption and propose f-separable distortion measures, which are well suited to model non-linear penalties. We prove a rate-distortion coding theorem for stationary ergodic sources with f-separable distortion measures, and provide some illustrative examples of the resulting rate-distortion functions.

UR - http://www.scopus.com/inward/record.url?scp=85018291070&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85018291070&partnerID=8YFLogxK

U2 - 10.1109/ITA.2016.7888172

DO - 10.1109/ITA.2016.7888172

M3 - Conference contribution

AN - SCOPUS:85018291070

T3 - 2016 Information Theory and Applications Workshop, ITA 2016

BT - 2016 Information Theory and Applications Workshop, ITA 2016

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2016 Information Theory and Applications Workshop, ITA 2016

Y2 - 31 January 2016 through 5 February 2016

ER -