TY - JOUR
T1 - Pre-existing visual responses in a projection-defined dopamine population explain individual learning trajectories
AU - International Brain Laboratory
AU - Pan-Vazquez, Alejandro
AU - Sanchez Araujo, Yoel
AU - McMannon, Brenna
AU - Louka, Miranta
AU - Bandi, Akhil
AU - Haetzel, Laura
AU - Faulkner, Mayo
AU - Pillow, Jonathan W.
AU - Daw, Nathaniel D.
AU - Witten, Ilana B.
N1 - Publisher Copyright:
© 2024 The Author(s)
PY - 2024/11/18
Y1 - 2024/11/18
N2 - A key challenge of learning a new task is that the environment is high dimensional—there are many different sensory features and possible actions, with typically only a small reward-relevant subset. Although animals can learn to perform complex tasks that involve arbitrary associations between stimuli, actions, and rewards,1,2,3,4,5,6 a consistent and striking result across varied experimental paradigms is that in initially acquiring such tasks, large differences between individuals are apparent in the learning process.7,8,9,10,11,12 What neural mechanisms contribute to initial task acquisition, and why do some individuals learn a new task much more quickly than others? To address these questions, we recorded longitudinally from dopaminergic (DA) axon terminals in mice learning a visual decision-making task.7 Across striatum, DA responses tracked idiosyncratic and side-specific learning trajectories, consistent with widespread reward prediction error coding across DA terminals. However, even before any rewards were delivered, contralateral-side-specific visual responses were present in DA terminals, primarily in the dorsomedial striatum (DMS). These pre-existing responses predicted the extent of learning for contralateral stimuli. Moreover, activation of these terminals improved contralateral performance. Thus, the initial conditions of a projection-specific and feature-specific DA signal help explain individual learning trajectories. More broadly, this work suggests that functional heterogeneity across DA projections may serve to bias target regions toward learning about different subsets of task features, providing a potential mechanism to address the dimensionality of the initial task learning problem.
AB - A key challenge of learning a new task is that the environment is high dimensional—there are many different sensory features and possible actions, with typically only a small reward-relevant subset. Although animals can learn to perform complex tasks that involve arbitrary associations between stimuli, actions, and rewards,1,2,3,4,5,6 a consistent and striking result across varied experimental paradigms is that in initially acquiring such tasks, large differences between individuals are apparent in the learning process.7,8,9,10,11,12 What neural mechanisms contribute to initial task acquisition, and why do some individuals learn a new task much more quickly than others? To address these questions, we recorded longitudinally from dopaminergic (DA) axon terminals in mice learning a visual decision-making task.7 Across striatum, DA responses tracked idiosyncratic and side-specific learning trajectories, consistent with widespread reward prediction error coding across DA terminals. However, even before any rewards were delivered, contralateral-side-specific visual responses were present in DA terminals, primarily in the dorsomedial striatum (DMS). These pre-existing responses predicted the extent of learning for contralateral stimuli. Moreover, activation of these terminals improved contralateral performance. Thus, the initial conditions of a projection-specific and feature-specific DA signal help explain individual learning trajectories. More broadly, this work suggests that functional heterogeneity across DA projections may serve to bias target regions toward learning about different subsets of task features, providing a potential mechanism to address the dimensionality of the initial task learning problem.
KW - basal ganglia
KW - dopamine
KW - dorsomedial striatum
KW - individual differences
KW - reinforcement learning
KW - visual decision-making
UR - http://www.scopus.com/inward/record.url?scp=85207807876&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85207807876&partnerID=8YFLogxK
U2 - 10.1016/j.cub.2024.09.045
DO - 10.1016/j.cub.2024.09.045
M3 - Article
C2 - 39413788
AN - SCOPUS:85207807876
SN - 0960-9822
VL - 34
SP - 5349-5358.e6
JO - Current Biology
JF - Current Biology
IS - 22
ER -