Intuitive Human-Robot Interface: A 3-Dimensional Action Recognition and UAV Collaboration Framework

Akash Chaudhary, Tiago Nascimento, Tiago Nascimento, Martin Saska

2024

Abstract

Harnessing human movements to command an Unmanned Aerial Vehicle (UAV) holds the potential to revolutionize their deployment, rendering it more intuitive and user-centric. In this research, we introduce a novel methodology adept at classifying three-dimensional human actions, leveraging them to coordinate on-field with a UAV. Utilizing a stereo camera, we derive both RGB and depth data, subsequently extracting three-dimensional human poses from the continuous video feed. This data is then processed through our proposed k-nearest neighbour classifier, the results of which dictate the behaviour of the UAV. It also includes mechanisms ensuring the robot perpetually maintains the human within its visual purview, adeptly tracking user movements. We subjected our approach to rigorous testing involving multiple tests with real robots. The ensuing results, coupled with comprehensive analysis, underscore the efficacy and inherent advantages of our proposed methodology.

Paper Citation

in Harvard Style

Chaudhary A., Nascimento T. and Saska M. (2024). Intuitive Human-Robot Interface: A 3-Dimensional Action Recognition and UAV Collaboration Framework. In Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO; ISBN 978-989-758-717-7, SciTePress, pages 26-35. DOI: 10.5220/0012921300003822

in Bibtex Style

@conference{icinco24,
author={Akash Chaudhary and Tiago Nascimento and Martin Saska},
title={Intuitive Human-Robot Interface: A 3-Dimensional Action Recognition and UAV Collaboration Framework},
booktitle={Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO},
year={2024},
pages={26-35},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012921300003822},
isbn={978-989-758-717-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO
TI - Intuitive Human-Robot Interface: A 3-Dimensional Action Recognition and UAV Collaboration Framework
SN - 978-989-758-717-7
AU - Chaudhary A.
AU - Nascimento T.
AU - Saska M.
PY - 2024
SP - 26
EP - 35
DO - 10.5220/0012921300003822
PB - SciTePress