TY - JOUR
T1 - Signed and unsigned reward prediction errors dynamically enhance learning and memory
AU - Rouhani, Nina
AU - Niv, Yael
N1 - Funding Information:
377 event) increased with learning. This mnemonic increase for cue events was supported by the gradual
Funding Information:
We thank Angela Radulescu and Isabel Berwian for helpful comments. This work was supported by grant W911NF-14-1-0101 from the Army Research Office (Y.N.), grant R01MH098861 from the National Institute for Mental Health (Y.N.), grant R21MH120798 from the National Institute of Health (Y.N.), and the National Science Foundation?s Graduate Research Fellowship Program (N.R.).
Funding Information:
This work was supported
Publisher Copyright:
© 2021, eLife Sciences Publications Ltd. All rights reserved.
PY - 2021/3
Y1 - 2021/3
N2 - Memory helps guide behavior, but which experiences from the past are priori-tized? Classic models of learning posit that events associated with unpredictable outcomes as well as, paradoxically, predictable outcomes, deploy more attention and learning for those events. Here, we test reinforcement learning and subsequent memory for those events, and treat signed and unsigned reward prediction errors (RPEs), experienced at the reward-predictive cue or reward outcome, as drivers of these two seemingly contradictory signals. By fitting reinforcement learning models to behavior, we find that both RPEs contribute to learning by modulat-ing a dynamically changing learning rate. We further characterize the effects of these RPE signals on memory, and show that both signed and unsigned RPEs enhance memory, in line with midbrain dopamine and locus-coeruleus modulation of hippocampal plasticity, thereby reconciling separate findings in the literature.
AB - Memory helps guide behavior, but which experiences from the past are priori-tized? Classic models of learning posit that events associated with unpredictable outcomes as well as, paradoxically, predictable outcomes, deploy more attention and learning for those events. Here, we test reinforcement learning and subsequent memory for those events, and treat signed and unsigned reward prediction errors (RPEs), experienced at the reward-predictive cue or reward outcome, as drivers of these two seemingly contradictory signals. By fitting reinforcement learning models to behavior, we find that both RPEs contribute to learning by modulat-ing a dynamically changing learning rate. We further characterize the effects of these RPE signals on memory, and show that both signed and unsigned RPEs enhance memory, in line with midbrain dopamine and locus-coeruleus modulation of hippocampal plasticity, thereby reconciling separate findings in the literature.
UR - http://www.scopus.com/inward/record.url?scp=85103330392&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85103330392&partnerID=8YFLogxK
U2 - 10.7554/eLife.61077
DO - 10.7554/eLife.61077
M3 - Article
C2 - 33661094
AN - SCOPUS:85103330392
SN - 2050-084X
VL - 10
JO - eLife
JF - eLife
M1 - e61077
ER -