Assess Performance Prediction Systems: Beyond Precision Indicators

Amal Ben Soussia, Chahrazed Labba, Azim Roussanaly, Anne Boyer

2022

Abstract

The high failure rate is a major concern in distance online education. In recent years, Performance Prediction Systems (PPS) based on different analytical methods have been proposed to predict at-risk of failure learners. One of the main studied characteristics of these systems is its ability to provide accurate early predictions. However, these systems are usually assessed using a set of evaluation measures (e.g. accuracy, precision) that do not reflect the precocity, continuity and evolution of the predictions over time. In this paper, we propose to enrich the existing indicators with time-dependent ones including earliness and stability. Further, we use the Harmonic Mean to illustrate the trade-off between the predictions earliness and the accuracy. In order to validate the relevance of our indicators, we used them to compare four different PPS for predicting at-risk of failure learners. These systems are applied on real data of K-12 learners enrolled in an online physics-chemistry module.

Paper Citation

in Harvard Style

Ben Soussia A., Labba C., Roussanaly A. and Boyer A. (2022). Assess Performance Prediction Systems: Beyond Precision Indicators. In Proceedings of the 14th International Conference on Computer Supported Education - Volume 1: A2E, ISBN 978-989-758-562-3, pages 489-496. DOI: 10.5220/0011124300003182

in Bibtex Style

@conference{a2e22,
author={Amal Ben Soussia and Chahrazed Labba and Azim Roussanaly and Anne Boyer},
title={Assess Performance Prediction Systems: Beyond Precision Indicators},
booktitle={Proceedings of the 14th International Conference on Computer Supported Education - Volume 1: A2E,},
year={2022},
pages={489-496},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011124300003182},
isbn={978-989-758-562-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Computer Supported Education - Volume 1: A2E,
TI - Assess Performance Prediction Systems: Beyond Precision Indicators
SN - 978-989-758-562-3
AU - Ben Soussia A.
AU - Labba C.
AU - Roussanaly A.
AU - Boyer A.
PY - 2022
SP - 489
EP - 496
DO - 10.5220/0011124300003182