Exploring Multimodal Interactions with a Robot Assistant in an Assembly Task: A Human-Centered Design Approach

Simona D’Attanasio, Théo Alabert, Clara Francis, Anna Studzinska

2024

Abstract

The rise of collaborative robots, or cobots, has opened up opportunities for shared operations between humans and robots. However, the transition to true human-robot collaboration faces challenges depending on the context and on the implemented interactions. This article aims to contribute to the evolving field of Human-Robot Interaction by addressing practical challenges in real-world scenarios and proposing a comprehensive approach to bidirectional communication between humans and robots. In particular, our research focuses on an elemental operation during an assembly task, observed in real SMEs (Small and Medium Sized Enterprises). We propose a multimodal bidirectional approach incorporating voice, gesture, visual, haptic, and feedback cues. The study involves a Wizard of Oz series of experiments with test subjects to evaluate user satisfaction, and the overall feeling of interaction, among other aspects. Preliminary analysis supports hypotheses related to the effectiveness of multimodality, the positive reception of simple interactions, and the impact of feedback on user experience.

Paper Citation

in Harvard Style

D’Attanasio S., Alabert T., Francis C. and Studzinska A. (2024). Exploring Multimodal Interactions with a Robot Assistant in an Assembly Task: A Human-Centered Design Approach. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP; ISBN 978-989-758-679-8, SciTePress, pages 549-556. DOI: 10.5220/0012570800003660

in Bibtex Style

@conference{hucapp24,
author={Simona D’Attanasio and Théo Alabert and Clara Francis and Anna Studzinska},
title={Exploring Multimodal Interactions with a Robot Assistant in an Assembly Task: A Human-Centered Design Approach},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP},
year={2024},
pages={549-556},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012570800003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP
TI - Exploring Multimodal Interactions with a Robot Assistant in an Assembly Task: A Human-Centered Design Approach
SN - 978-989-758-679-8
AU - D’Attanasio S.
AU - Alabert T.
AU - Francis C.
AU - Studzinska A.
PY - 2024
SP - 549
EP - 556
DO - 10.5220/0012570800003660
PB - SciTePress