Behavioral analysis at scale: Learning course prerequisite structures from learner clickstreams

Weiyu Chen, Andrew S. Lan, Da Cao, Christopher Brinton, Mung Chiang

Research output: Contribution to conferencePaper

Abstract

Knowledge of prerequisite dependencies is crucial to several aspects of learning, from the organization of learning content to the selection of personalized remediation or enrichment for each learner. As the amount of content is scaled up, however, it becomes increasingly difficult to manually specify all of the prerequisites among the different content parts, necessitating automation. Since existing approaches to automatically inferring prerequisite dependencies rely on analysis of content (e.g., topic modeling of text) or performance (e.g., quiz results tied to content) data, they are not feasible in cases where courses have no assessments or only short content pieces (e.g., short video segments). In this paper, we propose an algorithm that extracts prerequisite information using learner behavioral data instead of content and performance data, and apply it to an online short course. By modeling learner interaction with course content through a recurrent neural network-based architecture, our algorithm characterizes the prerequisite structure as latent variables, and estimates them from learner behavior. Through evaluation on a dataset of roughly 12,000 learners in a course we hosted on our platform, we show that our algorithm excels at both predicting behavior and revealing fine-granular insights into prerequisite dependencies between content segments, with validation provided by a course administrator. Our approach of content analytics using large-scale behavioral data complements existing approaches that focus on course content and/or performance data.

Original languageEnglish (US)
StatePublished - Jan 1 2018
Externally publishedYes
Event11th International Conference on Educational Data Mining, EDM 2018 - Buffalo, United States
Duration: Jul 15 2018Jul 18 2018

Conference

Conference11th International Conference on Educational Data Mining, EDM 2018
CountryUnited States
CityBuffalo
Period7/15/187/18/18

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Information Systems

Fingerprint Dive into the research topics of 'Behavioral analysis at scale: Learning course prerequisite structures from learner clickstreams'. Together they form a unique fingerprint.

  • Cite this

    Chen, W., Lan, A. S., Cao, D., Brinton, C., & Chiang, M. (2018). Behavioral analysis at scale: Learning course prerequisite structures from learner clickstreams. Paper presented at 11th International Conference on Educational Data Mining, EDM 2018, Buffalo, United States.