HOW DO EMOTIONAL STIMULI INFLUENCE THE LEARNER’S BRAIN ACTIVITY? - Tracking the Brainwave Frequency Bands Amplitudes

Alicia Heraz, Claude Frasson

Abstract

In this paper we discuss how learner’s electrical brain activity can be influenced by emotional stimuli. We conducted an experimentation in which we exposed a group of 17 learners to a series of pictures from the International Affective Picture System (IAPS) while their electrical brain activity was recorded. We got 33.106 recordings. In an exploratory study we examined the influence of 24 picture categories from the IAPS on the amplitude variations of the 4 brainwaves frequency bands: δ, φ, α and β. We used machine learning techniques to track the amplitudes in order to predict the dominant frequency band which inform about the learner mental and emotional states. Correlation and regression analyses show a significant impact of the emotional stimuli on the amplitudes of the brainwave frequency bands. Standard classification techniques were used to assess the reliability of the automatic prediction of the dominant frequency band. The reached accuracy was 90%. We discuss the prospects of extending our actual Brainwave-Sensing Multi Agent System to be integrated to an intelligent tutoring system (ITS) in the future.

References

  1. Bear, M.F., Connors, B.W., Paradiso, M. A, 2001. Neuroscience: Exploring the Brain, second ed. Lippincott Williams & Williams, Baltimore, MD.
  2. Bellifemine, F., Poggi, A., Rimassa, G., 1999. JADE - A FIPA-compliant Agent Framework, In PAAM'99, London, UK.
  3. Bradley, M.M., Codispoti, M., Cuthbert, B.N., Lang, P.J., 2001. Emotion and motivation: Defensive and appetitive reactions in picture processing. Emotion, 1.
  4. Cantor, D.S., 1999. An overview of quantitative EEG and its applications to neurofeedback. In Introduction to Quantitative EEG and Neurofeedback. J. R. Evans and A. Abarbanel, Eds. Academic Press.
  5. Conati, C., 2002. Probabilistic assessment of user's emotions in educational games. Journal of Applied Artificial Intelligence.
  6. Conati, C., 2004, How to evaluate models of user affect? In Proceedings of ADS 04, Tutorial and Research Workshop on Affective Dialogue Systems. Kloster Irsee, Germany.
  7. Conati, C., Mclaren H., 2005. Data-driven Refinement of a Probabilistic Model of User Affect. In Proceedings of UM2005 User Modeling: Proceedings of the Tenth International Conference, Lecture Notes in Computer Science, Springer Berlin / Heidelberg..
  8. D'Mello, S.K., Craig, S.D., Gholson, B., Franklin, S., Picard, R.W., Graesser, A.C., 2005. Integrating Affect Sensors in an Intelligent Tutoring System. In Affective Interactions: The Computer in the Affective Loop Workshop at 2005 International conference on Intelligent User Interfaces. AMC Press, New York.
  9. Ekman, P., 1992. Are there basic emotions? Psychological Review.
  10. Fan, C., Sarrafzadeh, A., Overmyer, S., Hosseini, H. G., Biglari-Abhari, M., Bigdeli, A., 2003. A fuzzy approach to facial expression analysis in intelligent tutoring systems. In Antonio Méndez-Vilas and J.A.Mesa González Eds.
  11. Heraz, A., Frasson, C., 2008. Predicting the three major dimensions of the learner's emotions from brainwaves. International Journal of Computer Science.
  12. Heraz, A., Razaki, R. Frasson, C., 2007. Using machine learning to predict learner emotional state from brainwaves. 7th IEEE conference on Advanced Learning Technologies: ICALT2007, Niigata, Japan.
  13. Kort, B., Reilly, R., Picard, R., 2001. An affective model of interplay between emotions and learning: Reengineering educational pedagogy-building a learning companion. In T. Okamoto, R. Hartley, Kinshuk, & J. P. Klus (Eds.), Proceedings IEEE International Conference on Advanced Learning Technology.
  14. Mandler, G., 1999. Emotion. In B. M. Bly & D. E. Rumelhart (Eds.), Cognitive science. Handbook of perception and cognition 2nd ed. San Diego, CA: Academic Press.
  15. McMilan, B., 2006. www.pocket-neurobics.com.
  16. Mikels J.A., Fredrickson, B. L., Larkin, G.R., Lindberg, C.M., Maglio, S.J., Reuter-Lorenz, P.A., 2005. Emotional category data on images from the International Affective Picture System, Behav Res Methods 37.
  17. Palke, A., 2004. Brainathlon: Enhancing Brainwave Control Through Brain-Controlled Game Play. Master thesis, Mills College, Oakland, California, USA.
  18. Panksepp, J., 1998. Affective neuroscience: The foundations of human and animal emotion. New York: Oxford University Press.
  19. Picard, R. W., 1997. Affective computing. Cambridge, Mass: MIT Press.
  20. Quinlan, R., 1993. C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann Publishers.
  21. Robson C., 1993. Real word research: A resource for social scientist and practitioner researchers. Oxford: Blackwell.
  22. Witten, I.H., Frank, E., 2005. Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, San Francisco.
  23. Youden, W.J., 1961. How to evaluate accuracy. Materials Research and Standards, ASTM.
Download


Paper Citation


in Harvard Style

Heraz A. and Frasson C. (2009). HOW DO EMOTIONAL STIMULI INFLUENCE THE LEARNER’S BRAIN ACTIVITY? - Tracking the Brainwave Frequency Bands Amplitudes . In Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8111-66-1, pages 14-20. DOI: 10.5220/0001558100140020


in Bibtex Style

@conference{icaart09,
author={Alicia Heraz and Claude Frasson},
title={HOW DO EMOTIONAL STIMULI INFLUENCE THE LEARNER’S BRAIN ACTIVITY? - Tracking the Brainwave Frequency Bands Amplitudes },
booktitle={Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2009},
pages={14-20},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001558100140020},
isbn={978-989-8111-66-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - HOW DO EMOTIONAL STIMULI INFLUENCE THE LEARNER’S BRAIN ACTIVITY? - Tracking the Brainwave Frequency Bands Amplitudes
SN - 978-989-8111-66-1
AU - Heraz A.
AU - Frasson C.
PY - 2009
SP - 14
EP - 20
DO - 10.5220/0001558100140020