TY - GEN
T1 - Interactive Theorem Provers for Proof Education
AU - Mahinpei, Romina
AU - Horta Ribeiro, Manoel
AU - Milano, Mae
N1 - Publisher Copyright:
© 2025 Owner/Author.
PY - 2025/10/9
Y1 - 2025/10/9
N2 - Proof techniques are a core component of computer science (CS) education, yet many CS students struggle to engage with and understand proof-based material. Interactive Theorem Provers (ITPs), originally developed for formal verification, have emerged as promising educational tools that offer structured feedback and align well with CS students' existing technical skills. While recent work has begun to explore the use of ITPs in educational settings, a notable gap remains: little is known about how well these tools support the range of proof techniques taught in CS curricula or how they might be improved to do so. We specifically seek to close this gap and contribute to the growing literature on ITPs in education through three concrete efforts: a user study of student experiences with the Coq proof assistant, a case study comparing proof development across Coq, Lean, and traditional methods, and a heuristic evaluation of each ITP using Nielsen's usability heuristics. Our results show that while the two ITPs can support the development of proof skills, they also present usability challenges - - such as complex syntax and unclear error messaging - - that can hinder learning. We also find that formalized ITP proofs tend to be more explicit and verbose than pen-and-paper proofs, which can affect students' perception of proof difficulty. Our heuristic evaluation highlights specific areas for improvement in Coq and Lean, including clearer error messages, support for example-driven learning, and expanding proof libraries to better align with educational needs. Together, these findings provide actionable insights for instructors considering ITPs for education and highlight both the pedagogical benefits and current limitations of these systems, as well as opportunities for researchers to improve ITPs as educational tools.
AB - Proof techniques are a core component of computer science (CS) education, yet many CS students struggle to engage with and understand proof-based material. Interactive Theorem Provers (ITPs), originally developed for formal verification, have emerged as promising educational tools that offer structured feedback and align well with CS students' existing technical skills. While recent work has begun to explore the use of ITPs in educational settings, a notable gap remains: little is known about how well these tools support the range of proof techniques taught in CS curricula or how they might be improved to do so. We specifically seek to close this gap and contribute to the growing literature on ITPs in education through three concrete efforts: a user study of student experiences with the Coq proof assistant, a case study comparing proof development across Coq, Lean, and traditional methods, and a heuristic evaluation of each ITP using Nielsen's usability heuristics. Our results show that while the two ITPs can support the development of proof skills, they also present usability challenges - - such as complex syntax and unclear error messaging - - that can hinder learning. We also find that formalized ITP proofs tend to be more explicit and verbose than pen-and-paper proofs, which can affect students' perception of proof difficulty. Our heuristic evaluation highlights specific areas for improvement in Coq and Lean, including clearer error messages, support for example-driven learning, and expanding proof libraries to better align with educational needs. Together, these findings provide actionable insights for instructors considering ITPs for education and highlight both the pedagogical benefits and current limitations of these systems, as well as opportunities for researchers to improve ITPs as educational tools.
KW - Interactive Theorem Provers
KW - Proof Education
UR - https://www.scopus.com/pages/publications/105021382430
UR - https://www.scopus.com/pages/publications/105021382430#tab=citedBy
U2 - 10.1145/3758317.3759679
DO - 10.1145/3758317.3759679
M3 - Conference contribution
AN - SCOPUS:105021382430
T3 - SPLASH-E 2025 - Proceedings of the 2025 ACM SIGPLAN International Symposium on SPLASH-E, Co-located with ICFP/SPLASH 2025
SP - 24
EP - 41
BT - SPLASH-E 2025 - Proceedings of the 2025 ACM SIGPLAN International Symposium on SPLASH-E, Co-located with ICFP/SPLASH 2025
A2 - Henz, Martin
A2 - Hermans, Felienne
A2 - Patterson, Daniel
PB - Association for Computing Machinery, Inc
T2 - 2025 ACM SIGPLAN International Symposium on SPLASH-E, SPLASH 2025, co-located with ICFP/SPLASH 2025
Y2 - 12 October 2025 through 18 October 2025
ER -