Channel Simulation and Coding With Side Information

Yossef Steinberg, Sergio Verdú

Research output: Contribution to journalArticlepeer-review

41 Scopus citations

Abstract

We study the minimum random bit rate required to simulate a random system (channel), where the simulator operates with a given external input, As measures of simulation accuracy we use both the variational distance and the d distance between joint input-output distributions. We find the asymptotic number of random bits per input sample required for accurate simulation, as a function of the distribution of the input process. These results hold for arbitrary channels and input processes, including nonstationary and nonergodic processes and do not hinge on a specific simulation scheme. A by-product of our analysis is a general formula for the minimal achievable source coding rate with side information.

Original languageEnglish (US)
Pages (from-to)634-646
Number of pages13
JournalIEEE Transactions on Information Theory
Volume40
Issue number3
DOIs
StatePublished - May 1994

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Keywords

  • Channel simlation
  • Source coding with side information
  • channel sup-entropy
  • conditional resolvability
  • conditional sup-entropy rate

Fingerprint Dive into the research topics of 'Channel Simulation and Coding With Side Information'. Together they form a unique fingerprint.

Cite this