The misbehavior of value and the discipline of the will

Peter Dayan, Yael Niv, Ben Seymour, Nathaniel D. Daw

Research output: Contribution to journalArticle

197 Scopus citations

Abstract

Most reinforcement learning models of animal conditioning operate under the convenient, though fictive, assumption that Pavlovian conditioning concerns prediction learning whereas instrumental conditioning concerns action learning. However, it is only through Pavlovian responses that Pavlovian prediction learning is evident, and these responses can act against the instrumental interests of the subjects. This can be seen in both experimental and natural circumstances. In this paper we study the consequences of importing this competition into a reinforcement learning context, and demonstrate the resulting effects in an omission schedule and a maze navigation task. The misbehavior created by Pavlovian values can be quite debilitating; we discuss how it may be disciplined.

Original languageEnglish (US)
Pages (from-to)1153-1160
Number of pages8
JournalNeural Networks
Volume19
Issue number8
DOIs
StatePublished - Oct 1 2006
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Cognitive Neuroscience
  • Artificial Intelligence

Keywords

  • Autoshaping
  • Classical conditioning
  • Instrumental conditioning
  • Negative automaintenance
  • Reinforcement learning
  • Will

Fingerprint Dive into the research topics of 'The misbehavior of value and the discipline of the will'. Together they form a unique fingerprint.

  • Cite this