Rapid decision threshold modulation by reward rate in a neural network

Patrick Simen, Jonathan D. Cohen, Philip Holmes

Research output: Contribution to journalArticlepeer-review

92 Scopus citations

Abstract

Optimal performance in two-alternative, free response decision-making tasks can be achieved by the drift-diffusion model of decision making-which can be implemented in a neural network-as long as the threshold parameter of that model can be adapted to different task conditions. Evidence exists that people seek to maximize reward in such tasks by modulating response thresholds. However, few models have been proposed for threshold adaptation, and none have been implemented using neurally plausible mechanisms. Here we propose a neural network that adapts thresholds in order to maximize reward rate. The model makes predictions regarding optimal performance and provides a benchmark against which actual performance can be compared, as well as testable predictions about the way in which reward rate may be encoded by neural mechanisms.

Original languageEnglish (US)
Pages (from-to)1013-1026
Number of pages14
JournalNeural Networks
Volume19
Issue number8
DOIs
StatePublished - Oct 2006

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Cognitive Neuroscience

Keywords

  • Decision making
  • Drift-diffusion
  • Reinforcement learning
  • Stochastic optimization

Fingerprint

Dive into the research topics of 'Rapid decision threshold modulation by reward rate in a neural network'. Together they form a unique fingerprint.

Cite this