Examining the Effectiveness of Different Assessments and Forecasts for Accurate Judgments of Learning in Engineering Classes

Christopher Cischke, Shane Mueller

2022

Abstract

Research and anecdotal evidence suggests that students are generally poor at predicting or forecasting how they will do at high-stakes testing in final exams. We hypothesize that better judgments of learning may allow students to choose more efficient study habits and practices that will improve their learning and their test scores. In order to inform interventions that might provide better forecasts, we examined student data from several university engineering courses. We examined how well three types of assessments predict final exam performance: performance on ungraded exercises; student forecasts prior to exams, and performance on graded material prior to exams. Results showed that ungraded exercises provided poor forecasts of exam performance, student predictions provided marginal forecasts, as did prior graded work in the course. The best predictor was found to be performance on previous high-stakes exams (i.e., midterms), whether or not these exams covered the same material as the later exam. Results suggest that interventions based on prior exam results may help students generate a better and more accurate forecast of their final exam scores.

Paper Citation

in Harvard Style

Cischke C. and Mueller S. (2022). Examining the Effectiveness of Different Assessments and Forecasts for Accurate Judgments of Learning in Engineering Classes. In Proceedings of the 14th International Conference on Computer Supported Education - Volume 1: A2E, ISBN 978-989-758-562-3, pages 497-503. DOI: 10.5220/0011124500003182

in Bibtex Style

@conference{a2e22,
author={Christopher Cischke and Shane Mueller},
title={Examining the Effectiveness of Different Assessments and Forecasts for Accurate Judgments of Learning in Engineering Classes},
booktitle={Proceedings of the 14th International Conference on Computer Supported Education - Volume 1: A2E,},
year={2022},
pages={497-503},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011124500003182},
isbn={978-989-758-562-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Computer Supported Education - Volume 1: A2E,
TI - Examining the Effectiveness of Different Assessments and Forecasts for Accurate Judgments of Learning in Engineering Classes
SN - 978-989-758-562-3
AU - Cischke C.
AU - Mueller S.
PY - 2022
SP - 497
EP - 503
DO - 10.5220/0011124500003182