Enhancing Student Engagement and Learning Outcomes Through Multimodal Robotic Interactions: A Study of non-Verbal Sound Recognition and Touch-Based Responses

Rezaul Tutul, Ilona Buchem, André Jakob

2025

Abstract

This study examines the impact of multimodal robotic interactions on student engagement, motivation, and learning outcomes in an educational quiz-based setting using the Pepper robot. Two interaction modalities were compared: touch-based inputs (control group) and non-verbal sound-driven responses (experimental group), where students used coughing, laughing, whistling, and clapping to select answers. A novel quantitative metric was introduced to evaluate the effect of sound-driven interactions on engagement by analysing sound frequency, recognition accuracy, and response patterns. A between-subjects experiment with 40 undergraduate students enrolled in a C programming course was conducted. Motivation and engagement were assessed using the Intrinsic Motivation Inventory (IMI), while learning outcomes were measured through quiz performance (accuracy and response time). The results indicate that sound-driven interactions significantly improved quiz performance compared to touch-based inputs suggesting enhanced cognitive processing and active participation. However, no significant difference in motivation or engagement was observed between the groups (IMI subscale analysis, p > 0.05). These findings highlight the potential of sound-driven human-robot interactions to enhance learning experiences by activating alternative cognitive pathways.

Paper Citation

in Harvard Style

Tutul R., Buchem I. and Jakob A. (2025). Enhancing Student Engagement and Learning Outcomes Through Multimodal Robotic Interactions: A Study of non-Verbal Sound Recognition and Touch-Based Responses. In Proceedings of the 17th International Conference on Computer Supported Education - Volume 2: CSEDU; ISBN 978-989-758-746-7, SciTePress, pages 131-138. DOI: 10.5220/0013353800003932

in Bibtex Style

@conference{csedu25,
author={Rezaul Tutul and Ilona Buchem and André Jakob},
title={Enhancing Student Engagement and Learning Outcomes Through Multimodal Robotic Interactions: A Study of non-Verbal Sound Recognition and Touch-Based Responses},
booktitle={Proceedings of the 17th International Conference on Computer Supported Education - Volume 2: CSEDU},
year={2025},
pages={131-138},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013353800003932},
isbn={978-989-758-746-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Conference on Computer Supported Education - Volume 2: CSEDU
TI - Enhancing Student Engagement and Learning Outcomes Through Multimodal Robotic Interactions: A Study of non-Verbal Sound Recognition and Touch-Based Responses
SN - 978-989-758-746-7
AU - Tutul R.
AU - Buchem I.
AU - Jakob A.
PY - 2025
SP - 131
EP - 138
DO - 10.5220/0013353800003932
PB - SciTePress