Relationship between learning engagement metrics and learning outcomes in online engineering course

Tiantian Li, Laura Melissa Cruz Castro, Kerrie Douglas, Christopher G. Brinton

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This research WIP contributes to understanding the relationship between learning engagement in Learning Management System (LMS) and outcomes in an online course. In large engineering courses, it is challenging for instructors to identify who is engaging with course materials at a level necessary to be successful in terms of course outcomes. The purpose of this research WIP study is two-fold: (1) to develop metrics for quantifying learner engagement in online courses, and (2) to explore the relationship between engagement and student success. Our research question is: How does learning engagement relate to course outcomes? We modeled learner engagement on a course level using the following features: number of views per content object, total time spent in the platform, percentage of the course accessed by the learners, percentage of feedback read, and number of attempts per quiz. We used the data collected by the LMS in a large first-year engineering course. We obtained data in Fall 2020, the first semester that many traditional universities were forced mostly or entirely online. After calculating the proposed metrics, we used a linear mixed model to analyze the effect of engagement on learning outcomes. Our linear mixed model shows that all engagement metrics are positively related to the final grade. However, the results also indicate that the relationship between engagement and learning outcomes is not linear; more complex modeling is needed to further explore this relationship.

Original languageEnglish (US)
Title of host publicationProceedings - 2021 IEEE Frontiers in Education Conference, FIE 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665438513
DOIs
StatePublished - 2021
Externally publishedYes
Event2021 IEEE Frontiers in Education Conference, FIE 2021 - Lincoln, United States
Duration: Oct 13 2021Oct 16 2021

Publication series

NameProceedings - Frontiers in Education Conference, FIE
Volume2021-October
ISSN (Print)1539-4565

Conference

Conference2021 IEEE Frontiers in Education Conference, FIE 2021
Country/TerritoryUnited States
CityLincoln
Period10/13/2110/16/21

All Science Journal Classification (ASJC) codes

  • Software
  • Education
  • Computer Science Applications

Keywords

  • generalized linear mixed model
  • learning engagement
  • learning outcome
  • online learning

Fingerprint

Dive into the research topics of 'Relationship between learning engagement metrics and learning outcomes in online engineering course'. Together they form a unique fingerprint.

Cite this