A Pipeline for the Automatic Evaluation of Dental Surgery Gestures in Preclinical Training from Captured Motions

Mohamed Hefied, Ludovic Hamon, Sébastien George, Valériane Loison, Fabrice Pirolli, Serena Lopez, Raphaëlle Crétin-Pirolli

2024

Abstract

This work in progress proposes an automatic evaluation pipeline for dental surgery gestures based on teacher’s demonstrations and observation needs. This pipeline aims at supporting learning in preclinical situations for the first years of study in the dental school. It uses the Random Forest (RF) algorithm to train a model based on specific descriptors for each gesture component, that are designed to cover the evolution of the observation needs. The inputs are the captured motion parts whose labels are defined by the teachers with their own vocabulary, to represent expected or no-wanted geometrical or kinematic features. The overall evaluation (for example, weighted average of each component) and the component evaluation can be given to students to improve their postures and motor skills. A preliminary test correctly classifies a back correct posture and three main flaws (”Twisted Back and Bent Head”, ”Leaning Back”, ”Leaning Back and Bent Back”) by the RF model, for the posture component. This approach is designed for the adaptation to the expert’s evolving observation needs while minimizing the need for a heavy re-engineering process and enhancing the system acceptance.

Paper Citation

in Harvard Style

Hefied M., Hamon L., George S., Loison V., Pirolli F., Lopez S. and Crétin-Pirolli R. (2024). A Pipeline for the Automatic Evaluation of Dental Surgery Gestures in Preclinical Training from Captured Motions. In Proceedings of the 16th International Conference on Computer Supported Education - Volume 1: CSEDU; ISBN 978-989-758-697-2, SciTePress, pages 420-427. DOI: 10.5220/0012685000003693

in Bibtex Style

@conference{csedu24,
author={Mohamed Hefied and Ludovic Hamon and Sébastien George and Valériane Loison and Fabrice Pirolli and Serena Lopez and Raphaëlle Crétin-Pirolli},
title={A Pipeline for the Automatic Evaluation of Dental Surgery Gestures in Preclinical Training from Captured Motions},
booktitle={Proceedings of the 16th International Conference on Computer Supported Education - Volume 1: CSEDU},
year={2024},
pages={420-427},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012685000003693},
isbn={978-989-758-697-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Computer Supported Education - Volume 1: CSEDU
TI - A Pipeline for the Automatic Evaluation of Dental Surgery Gestures in Preclinical Training from Captured Motions
SN - 978-989-758-697-2
AU - Hefied M.
AU - Hamon L.
AU - George S.
AU - Loison V.
AU - Pirolli F.
AU - Lopez S.
AU - Crétin-Pirolli R.
PY - 2024
SP - 420
EP - 427
DO - 10.5220/0012685000003693
PB - SciTePress