Assessing Mathematics Misunderstandings via Bayesian Inverse Planning

Anna N. Rafferty, Rachel A. Jansen, Thomas L. Griffiths

Research output: Contribution to journalArticlepeer-review

Abstract

Online educational technologies offer opportunities for providing individualized feedback and detailed profiles of students' skills. Yet many technologies for mathematics education assess students based only on the correctness of either their final answers or responses to individual steps. In contrast, examining the choices students make for how to solve the equation and the ways in which they might answer incorrectly offers the opportunity to obtain a more nuanced perspective of their algebra skills. To automatically make sense of step-by-step solutions, we propose a Bayesian inverse planning model for equation solving that computes an assessment of a learner's skills based on her pattern of errors in individual steps and her choices about what sequence of problem-solving steps to take. Bayesian inverse planning builds on existing machine learning tools to create a generative model relating (mis)-understandings to equation solving choices. Two behavioral experiments demonstrate that the model can interpret people's equation solving and that its assessments are consistent with those of experienced teachers. A third experiment uses this model to tailor guidance for learners based on individual differences in misunderstandings, closing the loop between assessing understanding, and using that assessment within an educational technology. Finally, because the bottleneck in applying inverse planning to a new domain is in creating the model of possible student misunderstandings, we show how to combine inverse planning with an existing production rule model to make inferences about student misunderstandings of fraction arithmetic.

Original languageEnglish (US)
Article numbere12900
JournalCognitive science
Volume44
Issue number10
DOIs
StatePublished - Oct 1 2020

All Science Journal Classification (ASJC) codes

  • Experimental and Cognitive Psychology
  • Cognitive Neuroscience
  • Artificial Intelligence

Keywords

  • Computational modeling
  • Equation solving
  • Inverse planning
  • Markov decision processes

Fingerprint Dive into the research topics of 'Assessing Mathematics Misunderstandings via Bayesian Inverse Planning'. Together they form a unique fingerprint.

Cite this