Integration of an Autonomous System with Human-in-the-Loop for Grasping an Unreachable Object in the Domestic Environment

Jaeseok Kim, Raffaele Limosani, Filippo Cavallo

2019

Abstract

In recent years, autonomous robots have proven capable of solving tasks in complex environments. In particular, robot manipulations in activities of daily living (ADL) for service robots have been widely developed. However, manipulations of grasping an unreachable object in domestic environments still present difficulty. To perform those applications better, we developed an autonomous system with human-in-the-loop that combined the cognitive skills of a human operator with autonomous robot behaviors. In this work, we present techniques for integration the system for assistive mobile manipulation and new strategies to support users in the domestic environment. We demonstrate that the robot can grasp multiple objects with random size at known and unknown table heights. Specifically, we developed three strategies for manipulation. We also demonstrated these strategies using two intuitive interfaces, a visual interface in rviz and a voice user interface with speech recognition. Moreover, the robot can select strategies automatically in random scenarios, which make the robot intelligent and able to make decisions independently in the environment. We demonstrated that our robot shows the capabilities for employment in domestic environments to perform actual tasks.

Paper Citation

in Harvard Style

Kim J., Limosani R. and Cavallo F. (2019). Integration of an Autonomous System with Human-in-the-Loop for Grasping an Unreachable Object in the Domestic Environment.In Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-758-380-3, pages 306-315. DOI: 10.5220/0007839503060315

in Bibtex Style

@conference{icinco19,
author={Jaeseok Kim and Raffaele Limosani and Filippo Cavallo},
title={Integration of an Autonomous System with Human-in-the-Loop for Grasping an Unreachable Object in the Domestic Environment},
booktitle={Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2019},
pages={306-315},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007839503060315},
isbn={978-989-758-380-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - Integration of an Autonomous System with Human-in-the-Loop for Grasping an Unreachable Object in the Domestic Environment
SN - 978-989-758-380-3
AU - Kim J.
AU - Limosani R.
AU - Cavallo F.
PY - 2019
SP - 306
EP - 315
DO - 10.5220/0007839503060315