ORIGINAL ARTICLE
Leveraging performance and feedback-seeking indicators
from a digital learning platform for early prediction of
students' learning outcomes
Teresa M. Ober | Ying Cheng | Matthew F. Carter | Cheng Liu
Department of Psychology, University of
Notre Dame, Dame, Indiana, USA
Correspondence
Teresa M. Ober, Department of Psychology,
University of Notre Dame, 390 Corbett Family
Hall, Notre Dame, IN 46556, USA.j
Email: tober@nd.edu
Funding information
Institute for Education Sciences, Grant/Award
Number: #R305A180269; National Science
Foundation, Grant/Award Number: CAREER /
#DRL-1350787
Abstract
Background: Students' tendencies to seek feedback are associated with improved
learning. Yet, how soon this association becomes robust enough to make predictions
about learning is not fully understood. Such knowledge has strong implications for
early identification of students at-risk for underachievement via digital learning
platforms.
Objectives: We sought to understand how early in the academic year students' end-
of-year learning outcomes could be predicted by their performance and feedback-
seeking behaviours within a digital learning platform. We analysed data collected at
different time points in the academic year and across different cohorts of students
within the context of high school advanced placement (AP) Statistics courses.
Methods: High school students enrolled in AP Statistics spanning three academic
years between 2017 and 2020 (N = 726; M
age
= 16.72 years) completed 3 or 4
homework assignments, each 2 and 3 months apart.
Results and conclusions: Across the three cohorts, and even as early as the first
assignment, a model consisting of demographic variables (gender, race/ethnicity,
parental education), assignment performance, and interaction with the digital score
report explained significant variation in students' final course grades (R
2
= 0.314–
0.412) and AP exam scores (κ = 0.583–0.689). Students' assignment performance
was positively associated with end-of-year learning outcomes. Students who more
frequently checked their digital score reports tended to receive better learning out-
comes, though not consistently across cohorts.
Implications: These findings further an understanding of how students' early perfor-
mance and feedback-seeking behaviours within a digital learning platform predict
end-of-year learning outcomes.
KEYWORDS
advanced placement, early prediction, multimodal data, process data, statistics education
1 | INTRODUCTION
Students' early academic performance within the context of a course
appears to have a clear association with eventual course outcomes
(e.g. Chrysafiadi & Virvou, 2013). In the context of classroom learning,
early indicators of performance may include scores on low-stakes
assignments, as well as quizzes or tests. Through students' use of a dig-
ital learning and assessment platform, not only is it possible to infer
Received: 13 November 2022 Revised: 17 July 2023 Accepted: 27 August 2023
DOI: 10.1111/jcal.12870
J Comput Assist Learn. 2023;1–22. wileyonlinelibrary.com/journal/jcal © 2023 John Wiley & Sons Ltd. 1