Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments

Yuan Chang Leong, Angela Radulescu, Reka Daniel, Vivian DeWoskin, Yael Niv

Research output: Contribution to journalArticlepeer-review

186 Scopus citations

Abstract

Little is known about the relationship between attention and learning during decision making. Using eye tracking and multivariate pattern analysis of fMRI data, we measured participants’ dimensional attention as they performed a trial-and-error learning task in which only one of three stimulus dimensions was relevant for reward at any given time. Analysis of participants’ choices revealed that attention biased both value computation during choice and value update during learning. Value signals in the ventromedial prefrontal cortex and prediction errors in the striatum were similarly biased by attention. In turn, participants’ focus of attention was dynamically modulated by ongoing learning. Attentional switches across dimensions correlated with activity in a frontoparietal attention network, which showed enhanced connectivity with the ventromedial prefrontal cortex between switches. Our results suggest a bidirectional interaction between attention and learning: attention constrains learning to relevant dimensions of the environment, while we learn what to attend to via trial and error.

Original languageEnglish (US)
Pages (from-to)451-463
Number of pages13
JournalNeuron
Volume93
Issue number2
DOIs
StatePublished - Jan 18 2017

All Science Journal Classification (ASJC) codes

  • General Neuroscience

Keywords

  • MVPA
  • attention
  • computational modeling
  • decision making
  • fMRI
  • prediction error
  • reinforcement learning
  • striatum
  • value
  • vmPFC

Fingerprint

Dive into the research topics of 'Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments'. Together they form a unique fingerprint.

Cite this