Dopamine selectively remediates 'model-based' reward learning: A computational approach

Madeleine E. Sharp, Karin Foerde, Nathaniel D. Daw, Daphna Shohamy

Research output: Contribution to journalArticle

46 Scopus citations

Abstract

Patients with loss of dopamine due to Parkinson's disease are impaired at learning from reward. However, it remains unknown precisely which aspect of learning is impaired. In particular, learning from reward, or reinforcement learning, can be driven by two distinct computational processes. One involves habitual stamping-in of stimulus-response associations, hypothesized to arise computationally from 'model-free' learning. The other, 'model-based' learning, involves learning a model of the world that is believed to support goal-directed behaviour. Much work has pointed to a role for dopamine in model-free learning. But recent work suggests model-based learning may also involve dopamine modulation, raising the possibility that model-based learning may contribute to the learning impairment in Parkinson's disease. To directly test this, we used a two-step reward-learning task which dissociates model-free versus model-based learning. We evaluated learning in patients with Parkinson's disease tested ON versus OFF their dopamine replacement medication and in healthy controls. Surprisingly, we found no effect of disease or medication on model-free learning. Instead, we found that patients tested OFF medication showed a marked impairment in model-based learning, and that this impairment was remediated by dopaminergic medication. Moreover, model-based learning was positively correlated with a separate measure of working memory performance, raising the possibility of common neural substrates. Our results suggest that some learning deficits in Parkinson's disease may be related to an inability to pursue reward based on complete representations of the environment.

Original languageEnglish (US)
Pages (from-to)355-364
Number of pages10
JournalBrain
Volume139
Issue number2
DOIs
StatePublished - Feb 1 2016
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Clinical Neurology

Keywords

  • Parkinson's disease
  • dopamine
  • model-based
  • model-free
  • reinforcement learning

Fingerprint Dive into the research topics of 'Dopamine selectively remediates 'model-based' reward learning: A computational approach'. Together they form a unique fingerprint.

  • Cite this