Channel Simulation and Coding With Side Information

Yossef Steinberg, Sergio Verdú

Research output: Contribution to journalArticlepeer-review

47 Scopus citations


We study the minimum random bit rate required to simulate a random system (channel), where the simulator operates with a given external input, As measures of simulation accuracy we use both the variational distance and the d distance between joint input-output distributions. We find the asymptotic number of random bits per input sample required for accurate simulation, as a function of the distribution of the input process. These results hold for arbitrary channels and input processes, including nonstationary and nonergodic processes and do not hinge on a specific simulation scheme. A by-product of our analysis is a general formula for the minimal achievable source coding rate with side information.

Original languageEnglish (US)
Pages (from-to)634-646
Number of pages13
JournalIEEE Transactions on Information Theory
Issue number3
StatePublished - May 1994

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences


  • Channel simlation
  • Source coding with side information
  • channel sup-entropy
  • conditional resolvability
  • conditional sup-entropy rate


Dive into the research topics of 'Channel Simulation and Coding With Side Information'. Together they form a unique fingerprint.

Cite this