ENSEMBLE APPROACHES TO PARAMETRIC DECISION FUSION FOR BIMODAL EMOTION RECOGNITION

Jonghwa Kim, Florian Lingenfelser

2010

Abstract

In this paper, we present a novel multi-ensemble technique for decision fusion of bimodal information. Exploiting the dichotomic property of 2D emotion model, various ensembles are built from given bimodal dataset containing multichannel physiological measures and speech. Through synergistic combination of the ensembles we investigated parametric schemes of decision-level fusion. Up to 18% of improved recognition accuracies are achieved compared to the results from unimodal classification.

References

  1. Bailenson, J., Pontikakis, E., Mauss, I., Gross, J., Jabon, M., Hutcherson, C., Nass, C., and John, C. (2008). Real-time classification of evoked emotions using facial feature tracking and physiological responses. Int'l Journal of Human-Computer Studies, 66(5):303-317.
  2. Chen, L. S., Huang, T. S., Miyasato, T., and Nakatsu, R. (1998). Multimodal human emotion/expression recognition. In Proc. 3rd Int. Conf. on Automatic Face and Gesture Recognition, IEEE Computer Soc., pages 366-371.
  3. Jain, A. and Zongker, D. (1997). Feature selection: Evaluation, application, and small sample performance. IEEE Trans. Pattern Anal. and Machine Intell., 19:153-163.
  4. Kim, J. and André, E. (2006). Emotion recognition using physiological and speech signal in short-term observation. In LNCS-Perception and Interactive Technologies, pages 53-64. Springer-Verlag Berlin Heidelberg.
  5. Kim, J. and André, E. (2008). Emotion recognition based on physiological changes in music listening. IEEE Trans. Pattern Anal. and Machine Intell., 30(12):2067-2083.
  6. Polikar, R. (2006). Ensemble based systems in decision making. IEEE Circuits and Systems Magazine, 6(3):21-45.
  7. Zeng, Z., Pantic, M., Roisman, G., and Huang, T. (2009). A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell., 31(1):39-58.
Download


Paper Citation


in Harvard Style

Kim J. and Lingenfelser F. (2010). ENSEMBLE APPROACHES TO PARAMETRIC DECISION FUSION FOR BIMODAL EMOTION RECOGNITION . In Proceedings of the Third International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2010) ISBN 978-989-674-018-4, pages 460-463. DOI: 10.5220/0002753204600463


in Bibtex Style

@conference{biosignals10,
author={Jonghwa Kim and Florian Lingenfelser},
title={ENSEMBLE APPROACHES TO PARAMETRIC DECISION FUSION FOR BIMODAL EMOTION RECOGNITION},
booktitle={Proceedings of the Third International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2010)},
year={2010},
pages={460-463},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002753204600463},
isbn={978-989-674-018-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2010)
TI - ENSEMBLE APPROACHES TO PARAMETRIC DECISION FUSION FOR BIMODAL EMOTION RECOGNITION
SN - 978-989-674-018-4
AU - Kim J.
AU - Lingenfelser F.
PY - 2010
SP - 460
EP - 463
DO - 10.5220/0002753204600463