loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Maxim Sidorov 1 ; Evgenii Sopov 2 ; Ilia Ivanov 2 and Wolfgang Minker 1

Affiliations: 1 Ulm University, Germany ; 2 Siberian State Aerospace University, Russian Federation

Keyword(s): Emotion Recognition, Speech, Vision, PCA, Neural Network, Human-Computer Interaction (HCI), Feature Level Fusion, Decision Level Fusion.

Related Ontology Subjects/Areas/Topics: Human-Machine Interfaces ; Hybrid Learning Systems ; Image Processing ; Informatics in Control, Automation and Robotics ; Intelligent Control Systems and Optimization ; Neural Networks Based Control Systems ; Robotics and Automation ; Vision, Recognition and Reconstruction

Abstract: The speech-based emotion recognition problem has already been investigated by many authors, and reasonable results have been achieved. This article focuses on applying audio-visual data fusion approach to emotion recognition. Two state-of-the-art classification algorithms were applied to one audio and three visual feature datasets. Feature level data fusion was applied to build a multimodal emotion classification system, which helped increase emotion classification accuracy by 4% compared to the best accuracy achieved by unimodal systems. The class precisions achieved by applying algorithms on unimodal and multimodal datasets helped to reveal that different data-classifier combinations are good at recognizing certain emotions. These data-classifier combinations were fused on the decision level using several approaches, which still helped increase the accuracy by 3% compared to the best accuracy achieved by feature level fusion.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.234.177.119

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Sidorov, M.; Sopov, E.; Ivanov, I. and Minker, W. (2015). Feature and Decision Level Audio-visual Data Fusion in Emotion Recognition Problem. In Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO; ISBN 978-989-758-123-6; ISSN 2184-2809, SciTePress, pages 246-251. DOI: 10.5220/0005527002460251

@conference{icinco15,
author={Maxim Sidorov. and Evgenii Sopov. and Ilia Ivanov. and Wolfgang Minker.},
title={Feature and Decision Level Audio-visual Data Fusion in Emotion Recognition Problem},
booktitle={Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO},
year={2015},
pages={246-251},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005527002460251},
isbn={978-989-758-123-6},
issn={2184-2809},
}

TY - CONF

JO - Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO
TI - Feature and Decision Level Audio-visual Data Fusion in Emotion Recognition Problem
SN - 978-989-758-123-6
IS - 2184-2809
AU - Sidorov, M.
AU - Sopov, E.
AU - Ivanov, I.
AU - Minker, W.
PY - 2015
SP - 246
EP - 251
DO - 10.5220/0005527002460251
PB - SciTePress