SIMPLE NEURAL NETWORKS THAT OPTIMIZE DECISIONS

Eric Brown, Juan Gao, Philip Holmes, Rafal Bogacz, Mark Gilzenrat, Jonathan D. Cohen

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

We review simple connectionist and firing rate models for mutually inhibiting pools of neurons that discriminate between pairs of stimuli. Both are two-dimensional nonlinear stochastic ordinary differential equations, and although they differ in how inputs and stimuli enter, we show that they are equivalent under state variable and parameter coordinate changes. A key parameter is gain: the maximum slope of the sigmoidal activation function. We develop piecewise-linear and purely linear models, and one-dimensional reductions to Ornstein-Uhlenbeck processes that can be viewed as linear filters, and show that reaction time and error rate statistics are well approximated by these simpler models. We then pose and solve the optimal gain problem for the Ornstein-Uhlenbeck processes, finding explicit gain schedules that minimize error rates for time-varying stimuli. We relate these to time courses of norepinephrine release in cortical areas, and argue that transient firing rate changes in the brainstem nucleus locus coeruleus may be responsible for approximate gain optimization.

Original languageEnglish (US)
Title of host publicationModeling and Computations in Dynamical Systems
Subtitle of host publicationIn Commemoration of the 100th Anniversary of the Birth of John von Neumann
PublisherWorld Scientific Publishing Co.
Pages107-130
Number of pages24
ISBN (Electronic)9789812774569
ISBN (Print)9812565965
DOIs
StatePublished - Jan 1 2006

All Science Journal Classification (ASJC) codes

  • General Mathematics

Keywords

  • decision task
  • Gain
  • locus coeruleus
  • matched filter
  • neural network model
  • optimal speed and accuracy
  • reaction time
  • stochastic differential equation

Fingerprint

Dive into the research topics of 'SIMPLE NEURAL NETWORKS THAT OPTIMIZE DECISIONS'. Together they form a unique fingerprint.

Cite this