The output distribution of good lossy source codes

Victoria Kostina, Sergio Verdu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

This paper provides a necessary condition good rate-distortion codes must satisfy. Specifically, it is shown that as the blocklength increases, the distribution of the input given the output of a good lossy code converges to the distribution of the input given the output of the joint distribution achieving the rate-distortion function, in terms of the normalized conditional relative entropy. The result holds for stationary ergodic sources with subadditive distortion measures, both for fixed-length and variable-length compression. A similar necessary condition is given for lossy joint source-channel coding.

Original languageEnglish (US)
Title of host publication2015 Information Theory and Applications Workshop, ITA 2015 - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages308-312
Number of pages5
ISBN (Electronic)9781479971954
DOIs
StatePublished - Oct 27 2015
EventInformation Theory and Applications Workshop, ITA 2015 - San Diego, United States
Duration: Feb 1 2015Feb 6 2015

Publication series

Name2015 Information Theory and Applications Workshop, ITA 2015 - Conference Proceedings

Other

OtherInformation Theory and Applications Workshop, ITA 2015
CountryUnited States
CitySan Diego
Period2/1/152/6/15

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Information Systems

Keywords

  • Distortion
  • Distortion measurement
  • Encoding
  • Entropy
  • Joints
  • Rate-distortion

Fingerprint Dive into the research topics of 'The output distribution of good lossy source codes'. Together they form a unique fingerprint.

Cite this