Dopamine and inference about timing

N. D. Daw, A. C. Courville, D. S. Touretzky

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Several investigators have suggested that the primate dopamine system carries an error signal for learning to predict future rewards. These models, based on temporal-difference (TD) learning, explain most phasic responses of primate dopamine neurons in appetitive conditioning; moreover, they suggest a neurophysiological account of animal conditioning behavior. But because existing models are based in the simple formal setting of Markov processes, they are deficient in at least two areas relevant to physiological and behavioral data. They do not provide a realistic account of the partial observability of the state of the world, nor of how the system tracks the timing of events. In this paper, we introduce a version of TD learning grounded in a richer formal model to better address both issues and, consequently, to explain some data that challenge existing models.

Original languageEnglish (US)
Title of host publicationProceedings - 2nd International Conference on Development and Learning, ICDL 2002
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages271-276
Number of pages6
ISBN (Electronic)0769514596, 9780769514598
DOIs
StatePublished - Jan 1 2002
Externally publishedYes
Event2nd International Conference on Development and Learning, ICDL 2002 - Cambridge, United States
Duration: Jun 12 2002Jun 15 2002

Publication series

NameProceedings - 2nd International Conference on Development and Learning, ICDL 2002

Other

Other2nd International Conference on Development and Learning, ICDL 2002
CountryUnited States
CityCambridge
Period6/12/026/15/02

All Science Journal Classification (ASJC) codes

  • Computational Theory and Mathematics
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Dopamine and inference about timing'. Together they form a unique fingerprint.

  • Cite this

    Daw, N. D., Courville, A. C., & Touretzky, D. S. (2002). Dopamine and inference about timing. In Proceedings - 2nd International Conference on Development and Learning, ICDL 2002 (pp. 271-276). [1011901] (Proceedings - 2nd International Conference on Development and Learning, ICDL 2002). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/DEVLRN.2002.1011901