No Need for a Lab: Towards Multi-sensory Fusion for Ambient Assisted Living in Real-world Living Homes

Alessandro Masullo, Toby Perrett, Dima Damen, Tilo Burghardt, Majid Mirmehdi

2021

Abstract

The majority of the Ambient Assisted Living (AAL) systems, designed for home or lab settings, monitor one participant at a time – this is to avoid the complexities of pre-fusion correspondence of different sensors since carers, guests, and visitors may be involved in real world scenarios. Previous work from (Masullo et al., 2020) presented a solution to this problem that involves matching video sequences of silhouettes to accelerations from wearable sensors to identify members of a household while respecting their privacy. In this work, we elevate this approach to the next stage by improving its architecture and combining it with a tracking functionality that makes it possible to be deployed in real-world homes. We present experiments on a new dataset recorded in participants’ own houses, which includes multiple participants visited by guests, and show an auROC score of 90.2%. We also show a novel first example of subject-tailored health monitoring measurement by applying our methodology to a sit-to-stand detector to generate clinically relevant rehabilitation trends.

Paper Citation

in Harvard Style

Masullo A., Perrett T., Damen D., Burghardt T. and Mirmehdi M. (2021). No Need for a Lab: Towards Multi-sensory Fusion for Ambient Assisted Living in Real-world Living Homes. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP; ISBN 978-989-758-488-6, SciTePress, pages 328-337. DOI: 10.5220/0010202903280337

in Bibtex Style

@conference{visapp21,
author={Alessandro Masullo and Toby Perrett and Dima Damen and Tilo Burghardt and Majid Mirmehdi},
title={No Need for a Lab: Towards Multi-sensory Fusion for Ambient Assisted Living in Real-world Living Homes},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP},
year={2021},
pages={328-337},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010202903280337},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP
TI - No Need for a Lab: Towards Multi-sensory Fusion for Ambient Assisted Living in Real-world Living Homes
SN - 978-989-758-488-6
AU - Masullo A.
AU - Perrett T.
AU - Damen D.
AU - Burghardt T.
AU - Mirmehdi M.
PY - 2021
SP - 328
EP - 337
DO - 10.5220/0010202903280337
PB - SciTePress