Human Motion Prediction on the IKEA-ASM Dataset

Mattias Billast, Kevin Mets, Tom De Schepper, José Oramas, Steven Latré

2023

Abstract

Motion prediction of the human pose estimates future poses based on the preceding poses. It is a stepping stone toward industrial applications, like human-robot interactions and ergonomy indicators. The goal is to minimize the error in predicted joint positions on the IKEA-ASM dataset which resembles assembly use cases with a high diversity of execution and background of the same action class. In this paper, we use the STS-GCN model to tackle 2D motion prediction and make various alterations to improve the performance of the model. First, we pre-processed the training dataset through filtering to remove outliers and inconsistencies to boost performance by 31%. Secondly, we added object gaze information to give more context to the body motion of the subject, which lowers the error (MPJPE) to 10.1618 compared to 18.3462 without object gaze information. The increased performance indicates that there is a correlation between the object gaze and body motion. Lastly, the over-smoothing of the Graph Convolutional Network embeddings is decreased by limiting the number of layers, providing richer joint embeddings.

Paper Citation

in Harvard Style

Billast M., Mets K., De Schepper T., Oramas J. and Latré S. (2023). Human Motion Prediction on the IKEA-ASM Dataset. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 5: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 906-914. DOI: 10.5220/0011902300003417

in Bibtex Style

@conference{visapp23,
author={Mattias Billast and Kevin Mets and Tom De Schepper and José Oramas and Steven Latré},
title={Human Motion Prediction on the IKEA-ASM Dataset},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 5: VISAPP},
year={2023},
pages={906-914},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011902300003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 5: VISAPP
TI - Human Motion Prediction on the IKEA-ASM Dataset
SN - 978-989-758-634-7
AU - Billast M.
AU - Mets K.
AU - De Schepper T.
AU - Oramas J.
AU - Latré S.
PY - 2023
SP - 906
EP - 914
DO - 10.5220/0011902300003417
PB - SciTePress