Visual Servoing for Vine Pruning Based on Point Cloud Alignment

Fadi Gebrayel, Martin Mujica, Patrick Danès

2024

Abstract

This paper addresses the challenge of vine pruning, a crucial and laborious task in agriculture, using robotic technologies and vision based feedback control. The complex structure of vines makes visual servoing difficult due to challenges in 3D pose estimation and feature extraction. A novel approach to vision based vine pruning is proposed, based on the combination of Iterative Closest Point (ICP) point-cloud alignment and position-based visual servoing (PBVS). Four ICP variants are compared within PBVS in vine pruning scenarios: standard ICP, Levenberg–Marquardt ICP, Point-to-Plane ICP, and Symmetric ICP. The methodology includes a dedicated ICP initial guess to improve alignment speed and accuracy, as well as a procedure for generating reference point clouds at pruning locations. Live experiments were conducted on a Franka Emika manipulator equipped with a stereo camera, involving three real vines under laboratory conditions.

Paper Citation

in Harvard Style

Gebrayel F., Mujica M. and Danès P. (2024). Visual Servoing for Vine Pruning Based on Point Cloud Alignment. In Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO; ISBN 978-989-758-717-7, SciTePress, pages 416-423. DOI: 10.5220/0013015200003822

in Bibtex Style

@conference{icinco24,
author={Fadi Gebrayel and Martin Mujica and Patrick Danès},
title={Visual Servoing for Vine Pruning Based on Point Cloud Alignment},
booktitle={Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO},
year={2024},
pages={416-423},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013015200003822},
isbn={978-989-758-717-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO
TI - Visual Servoing for Vine Pruning Based on Point Cloud Alignment
SN - 978-989-758-717-7
AU - Gebrayel F.
AU - Mujica M.
AU - Danès P.
PY - 2024
SP - 416
EP - 423
DO - 10.5220/0013015200003822
PB - SciTePress