Convergence in human decision-making dynamics

Ming Cao, Andrew Stewart, Naomi Ehrich Leonard

Research output: Contribution to journalArticle

15 Scopus citations

Abstract

A class of binary decision-making tasks called the two-alternative forced-choice task has been used extensively in psychology and behavioral economics experiments to investigate human decision making. The human subject makes a choice between two options at regular time intervals and receives a reward after each choice; for a variety of reward structures, these experiments show convergence of the aggregate behavior to rewards that are often suboptimal. In this paper we present two models of human decision making: one is the Win-Stay, Lose-Switch (WSLS) model and the other is a deterministic limit of the popular Drift Diffusion (DD) model. With these models we prove the convergence of human behavior to the observed aggregate decision making for reward structures with matching points. The analysis is motivated by human-in-the-loop systems, where humans are often required to make repeated choices among finite alternatives in response to evolving system performance measures. We discuss application of the convergence result to the design of human-in-the-loop systems using a map from the human subject to a human supervisor.

Original languageEnglish (US)
Pages (from-to)87-97
Number of pages11
JournalSystems and Control Letters
Volume59
Issue number2
DOIs
StatePublished - Feb 2010

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Computer Science(all)
  • Mechanical Engineering
  • Electrical and Electronic Engineering

Keywords

  • Drift diffusion model
  • Explore vs. exploit
  • Human decision making
  • Robotic foraging
  • Two-alternative forced-choice task
  • Win-stay, lose-switch model

Fingerprint Dive into the research topics of 'Convergence in human decision-making dynamics'. Together they form a unique fingerprint.

  • Cite this