Minimum expected distortion in Gaussian source coding with uncertain side information

Chris T.K. Ng, Chao Tian, Andrea J. Goldsmith, Shlomo Shamai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Scopus citations


We consider a layered approach to source coding with side information received over an uncertain channel that minimizes expected distortion. Specifically, we assume a Gaussian source encoder whereby the decoder receives a compressed version of the symbol at a given rate, as well as an uncompressed version over a separate side-information channel with slow fading and noise. The decoder knows the realization of the slow fading but the encoder knows only its distribution. We consider a layered encoding strategy with a base layer describing the source assuming worst-case fading on the side-information channel, and subsequent layers describing the source under better fading conditions. Optimization of the layering scheme utilizes the Heegard-Berger rate-distortion function that describes the rate required to meet a different distortion constraint for each fading state. When the side-information channel has two discrete fading states, we obtain closed-form expressions for the optimal rate allocation between the fading states and the resulting minimum expected distortion. For multiple fading states, the minimum expected distortion is formulated as the solution of a convex optimization problem. Under discretized Rayleigh fading, we show that the optimal rate allocation puts almost all rate into the base layer associated with the worst-case fading. This implies that uncertain side information yields little performance benefit over no side information. Moreover, as the source coding rate increases, the benefit of uncertain side-information decreases.

Original languageEnglish (US)
Title of host publication2007 IEEE Information Theory Workshop, ITW 2007, Proceedings
Number of pages6
StatePublished - 2007
Externally publishedYes
Event2007 IEEE Information Theory Workshop, ITW 2007 - Lake Tahoe, CA, United States
Duration: Sep 2 2007Sep 6 2007

Publication series

Name2007 IEEE Information Theory Workshop, ITW 2007, Proceedings


Other2007 IEEE Information Theory Workshop, ITW 2007
Country/TerritoryUnited States
CityLake Tahoe, CA

All Science Journal Classification (ASJC) codes

  • Computational Theory and Mathematics
  • Information Systems
  • Information Systems and Management


Dive into the research topics of 'Minimum expected distortion in Gaussian source coding with uncertain side information'. Together they form a unique fingerprint.

Cite this