In Search of Learning Indicators: A Study on Sensor Data and IAPS Emotional Pictures

Haeseon Yun, Albrecht Fortenbacher, René Helbig, Niels Pinkwart

2019

Abstract

The goal of our research presented in this paper is to relate emotions to sensor data (heart rate and skin conductivity), to interpret them in a learning context (academic emotions) and finally derive learning indicators. For this purpose, we collected sensor data from 27 participants during an emotional picture experiment provided by IAPS (International Affective Picture System). The collected data included EDA signals (electrodermal activity), heart rate and derived data such as skin conductance response, skin conductance level, heart rate variability and instantaneous heart rate labeled by IAPS reference rating and participants’ self ratings. The processed data were analyzed using qualitative and quantitative methods as well as machine learning. Furthermore, we applied a human-machine combined approach, namely fuzzy logic reasoning. Our results show that the change of EDA when emotion is induced may serve as a feature to distinguish the intensity of emotion (arousal). Also, classifying EDA signals using a random forest approach shows the best accuracy. In search of learning indicators, we have attempted various tracks of analysis in this study which revealed novel findings, limitations and future steps to consider.

Paper Citation

in Harvard Style

Yun H., Fortenbacher A., Helbig R. and Pinkwart N. (2019). In Search of Learning Indicators: A Study on Sensor Data and IAPS Emotional Pictures.In Proceedings of the 11th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-367-4, pages 111-121. DOI: 10.5220/0007734301110121

in Bibtex Style

@conference{csedu19,
author={Haeseon Yun and Albrecht Fortenbacher and René Helbig and Niels Pinkwart},
title={In Search of Learning Indicators: A Study on Sensor Data and IAPS Emotional Pictures},
booktitle={Proceedings of the 11th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2019},
pages={111-121},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007734301110121},
isbn={978-989-758-367-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - In Search of Learning Indicators: A Study on Sensor Data and IAPS Emotional Pictures
SN - 978-989-758-367-4
AU - Yun H.
AU - Fortenbacher A.
AU - Helbig R.
AU - Pinkwart N.
PY - 2019
SP - 111
EP - 121
DO - 10.5220/0007734301110121