Efficient representation as a design principle for neural coding and computation

William Bialek, Rob R. De Ruyter Van Steveninck, Naftali Tishby

Research output: Chapter in Book/Report/Conference proceedingConference contribution

22 Scopus citations

Abstract

Does the brain construct an efficient representation of the sensory world? We review progress on this question, focusing on a series of experiments in the last decade which use fly vision as a model system in which theory and experiment can confront each other. Although the idea of efficient representation has been productive, clearly it is incomplete since it doesn't tell us which bits of sensory information are most valuable to the organism. We argue that, in fact, an organism which maximizes the (biologically meaningful) adaptive value of its actions given fixed resources must have internal representations of the outside world that are optimal in a very specific information theoretic sense: they maximize the information about the future of sensory inputs at a fixed value of the information about their past. This principle contains as special cases computations which the brain seems to carry out, and it should be possible to test this optimization directly. We return to the fly visual system and report the results of preliminary experiments that are in very suggestive agreement with theory.

Original languageEnglish (US)
Title of host publicationProceedings - 2006 IEEE International Symposium on Information Theory, ISIT 2006
Pages659-663
Number of pages5
DOIs
StatePublished - Dec 1 2006
Event2006 IEEE International Symposium on Information Theory, ISIT 2006 - Seattle, WA, United States
Duration: Jul 9 2006Jul 14 2006

Publication series

NameIEEE International Symposium on Information Theory - Proceedings
ISSN (Print)2157-8101

Other

Other2006 IEEE International Symposium on Information Theory, ISIT 2006
CountryUnited States
CitySeattle, WA
Period7/9/067/14/06

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Information Systems
  • Modeling and Simulation
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Efficient representation as a design principle for neural coding and computation'. Together they form a unique fingerprint.

  • Cite this

    Bialek, W., De Ruyter Van Steveninck, R. R., & Tishby, N. (2006). Efficient representation as a design principle for neural coding and computation. In Proceedings - 2006 IEEE International Symposium on Information Theory, ISIT 2006 (pp. 659-663). [4036045] (IEEE International Symposium on Information Theory - Proceedings). https://doi.org/10.1109/ISIT.2006.261867