An Augmented Reality Mirror Exergame using 2D Pose Estimation

Fernando Losilla, Francisca Rosique

2019

Abstract

Exergames have become very popular for fitness and rehabilitation purposes. They usually rely on RGB-D sensors to estimate human 3D body pose and, therefore, allow users to interact with virtual environments. Currently, a new generation of deep learning techniques enable the estimation of 2D body pose from video sequences. These video sequences could be augmented with the estimated pose and other virtual objects, resulting in augmented reality mirrors where players can see their reflection along with other visual cues that guide them through exercises. The main benefit of using this approach would be replacing RGB-D cameras with simpler and more widely available webcams. This approach is explored in this work with the development of the ExerCam exergame. This application relies on a single webcam and the OpenPose library to allow users to perform exercises where they have to reach virtual targets appearing on the screen. A preliminary study has been performed in order to explore the technical viability and usability of this application, with promising results.

Paper Citation

in Harvard Style

Losilla F. and Rosique F. (2019). An Augmented Reality Mirror Exergame using 2D Pose Estimation.In Proceedings of the 14th International Conference on Software Technologies - Volume 1: ICSOFT, ISBN 978-989-758-379-7, pages 643-648. DOI: 10.5220/0007798906430648

in Bibtex Style

@conference{icsoft19,
author={Fernando Losilla and Francisca Rosique},
title={An Augmented Reality Mirror Exergame using 2D Pose Estimation},
booktitle={Proceedings of the 14th International Conference on Software Technologies - Volume 1: ICSOFT,},
year={2019},
pages={643-648},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007798906430648},
isbn={978-989-758-379-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Software Technologies - Volume 1: ICSOFT,
TI - An Augmented Reality Mirror Exergame using 2D Pose Estimation
SN - 978-989-758-379-7
AU - Losilla F.
AU - Rosique F.
PY - 2019
SP - 643
EP - 648
DO - 10.5220/0007798906430648