Multimodal Deep Denoising Convolutional Autoencoders for Pain Intensity Classification based on Physiological Signals

Patrick Thiam, Patrick Thiam, Hans Kestler, Friedhelm Schwenker

2020

Abstract

The performance of a conventional information fusion architecture is greatly affected by its ability to detect and combine useful and complementary information from heterogeneous representations stemming from a set of distinctive modalities. Moreover, manually designing a set of relevant and complementary features for a specific pattern recognition task is a complex and tedious endeavour. Therefore, enabling pattern recognition architectures to autonomously generate and select relevant descriptors directly from the set of preprocessed raw data is a favourable alternative to the more conventional manual feature engineering. In the following work, multimodal information fusion approaches based on Deep Denoising Convolutional Autoencoders (DDCAEs) are proposed for the classification of pain intensities based on physiological signals (electrodermal activity (EDA), electromyogram (EMG) and electrocardiogram (ECG)). The approaches are characterized by the simultaneous optimization of both the joint representation of the input channels generated by the multimodal DDCAE and the feed-forward neural network performing the classification of the pain intensities. The assessment performed on the BioVid Heat Pain Database (Part A) points at the relevance of the proposed approaches. In particular, the introduction of trainable weighting parameters for the generation of an aggregated latent representation outperforms most of the previously proposed methods in related works, each based on a set of carefully selected hand-crafted features.

Paper Citation

in Harvard Style

Thiam P., Kestler H. and Schwenker F. (2020). Multimodal Deep Denoising Convolutional Autoencoders for Pain Intensity Classification based on Physiological Signals. In Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-397-1, pages 289-296. DOI: 10.5220/0008896102890296

in Bibtex Style

@conference{icpram20,
author={Patrick Thiam and Hans Kestler and Friedhelm Schwenker},
title={Multimodal Deep Denoising Convolutional Autoencoders for Pain Intensity Classification based on Physiological Signals},
booktitle={Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2020},
pages={289-296},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008896102890296},
isbn={978-989-758-397-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Multimodal Deep Denoising Convolutional Autoencoders for Pain Intensity Classification based on Physiological Signals
SN - 978-989-758-397-1
AU - Thiam P.
AU - Kestler H.
AU - Schwenker F.
PY - 2020
SP - 289
EP - 296
DO - 10.5220/0008896102890296