TY - JOUR
T1 - Signed and unsigned reward prediction errors dynamically enhance learning and memory
AU - Rouhani, Nina
AU - Niv, Yael
N1 - Publisher Copyright:
© 2021, eLife Sciences Publications Ltd. All rights reserved.
PY - 2021/3
Y1 - 2021/3
N2 - Memory helps guide behavior, but which experiences from the past are priori-tized? Classic models of learning posit that events associated with unpredictable outcomes as well as, paradoxically, predictable outcomes, deploy more attention and learning for those events. Here, we test reinforcement learning and subsequent memory for those events, and treat signed and unsigned reward prediction errors (RPEs), experienced at the reward-predictive cue or reward outcome, as drivers of these two seemingly contradictory signals. By fitting reinforcement learning models to behavior, we find that both RPEs contribute to learning by modulat-ing a dynamically changing learning rate. We further characterize the effects of these RPE signals on memory, and show that both signed and unsigned RPEs enhance memory, in line with midbrain dopamine and locus-coeruleus modulation of hippocampal plasticity, thereby reconciling separate findings in the literature.
AB - Memory helps guide behavior, but which experiences from the past are priori-tized? Classic models of learning posit that events associated with unpredictable outcomes as well as, paradoxically, predictable outcomes, deploy more attention and learning for those events. Here, we test reinforcement learning and subsequent memory for those events, and treat signed and unsigned reward prediction errors (RPEs), experienced at the reward-predictive cue or reward outcome, as drivers of these two seemingly contradictory signals. By fitting reinforcement learning models to behavior, we find that both RPEs contribute to learning by modulat-ing a dynamically changing learning rate. We further characterize the effects of these RPE signals on memory, and show that both signed and unsigned RPEs enhance memory, in line with midbrain dopamine and locus-coeruleus modulation of hippocampal plasticity, thereby reconciling separate findings in the literature.
UR - http://www.scopus.com/inward/record.url?scp=85103330392&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85103330392&partnerID=8YFLogxK
U2 - 10.7554/eLife.61077
DO - 10.7554/eLife.61077
M3 - Article
C2 - 33661094
AN - SCOPUS:85103330392
SN - 2050-084X
VL - 10
JO - eLife
JF - eLife
M1 - e61077
ER -