Dual credit assignment processes underlie dopamine signals in a complex spatial environment

Timothy A. Krausz, Alison E. Comrie, Ari E. Kahn, Loren M. Frank, Nathaniel D. Daw, Joshua D. Berke

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Animals frequently make decisions based on expectations of future reward (“values”). Values are updated by ongoing experience: places and choices that result in reward are assigned greater value. Yet, the specific algorithms used by the brain for such credit assignment remain unclear. We monitored accumbens dopamine as rats foraged for rewards in a complex, changing environment. We observed brief dopamine pulses both at reward receipt (scaling with prediction error) and at novel path opportunities. Dopamine also ramped up as rats ran toward reward ports, in proportion to the value at each location. By examining the evolution of these dopamine place-value signals, we found evidence for two distinct update processes: progressive propagation of value along taken paths, as in temporal difference learning, and inference of value throughout the maze, using internal models. Our results demonstrate that within rich, naturalistic environments dopamine conveys place values that are updated via multiple, complementary learning algorithms.

Original languageEnglish (US)
Pages (from-to)3465-3478.e7
JournalNeuron
Volume111
Issue number21
DOIs
StatePublished - Nov 1 2023

All Science Journal Classification (ASJC) codes

  • General Neuroscience

Keywords

  • credit assignment
  • decision-making
  • dopamine
  • maze
  • navigation
  • reinforcement learning

Fingerprint

Dive into the research topics of 'Dual credit assignment processes underlie dopamine signals in a complex spatial environment'. Together they form a unique fingerprint.

Cite this