### Abstract

Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible [Formula presented]-point correlation is measured by a decrease in entropy for the joint distribution of [Formula presented] variables relative to the maximum entropy allowed by all the observed [Formula presented] variable distributions. We calculate the “connected information” terms for several examples and show that it also enables the decomposition of the information that is carried by a population of elements about an outside source.

Original language | English (US) |
---|---|

Journal | Physical review letters |

Volume | 91 |

Issue number | 23 |

DOIs | |

State | Published - Jan 1 2003 |

### All Science Journal Classification (ASJC) codes

- Physics and Astronomy(all)

## Fingerprint Dive into the research topics of 'Network information and connected correlations'. Together they form a unique fingerprint.

## Cite this

Schneidman, E., Still, S., Berry, M. J., & Bialek, W. (2003). Network information and connected correlations.

*Physical review letters*,*91*(23). https://doi.org/10.1103/PhysRevLett.91.238701