Real-time Vision-based UAV Navigation in Fruit Orchards

Dries Hulens, Maarten Vandersteegen, Toon Goedemé

2017

Abstract

Unmanned Aerial Vehicles (UAV) enable numerous agricultural applications such as terrain mapping, monitor crop growth, detecting areas with diseases and so on. For these applications a UAV flies above the terrain and has a global view of the plants. When the individual fruits or plants have to be examined, an oblique view is better, e.g. via an inspection-camera mounted on expensive all-terrain wheeled robots that drive through the orchard. However, in this paper we aim to autonomously navigate through the orchard with a low-cost UAV and cheap sensors (e.g. a webcam). Evidently, this is challenging since every orchard or even every corridor looks different. For this we developed a vision-based system that detects the center and end of the corridor to autonomously navigate the UAV towards the end of the orchard without colliding with the trees. Furthermore extensive experiments were performed to prove that our algorithm is able to navigate through the orchard with high accuracy and in real-time, even on embedded hardware. A connection with a ground station is thus unnecessary which makes the UAV fully autonomous.

References

  1. Andersen, J. C., Ravn, O., and Andersen, N. A. (2010). Autonomous rule-based robot navigation in orchards. IFAC Proceedings Volumes, 43(16):43-48.
  2. Barawid, O. C., Mizushima, A., Ishii, K., and Noguchi, N. (2007). Development of an autonomous navigation system using a two-dimensional laser scanner in an orchard application. Biosystems Engineering, 96(2):139-149.
  3. Christiansen, M. P., Jensen, K., Ellekilde, L.-P., and Jørgensen, R. N. (2011). Localization in orchards using extended Kalman filter for sensor-fusion-a frobomind component.
  4. Colomina, I. and Molina, P. (2014). Unmanned aerial systems for photogrammetry and remote sensing: A review. ISPRS Journal of Photogrammetry and Remote Sensing, 92:79-97.
  5. Garcia-Ruiz, F., Sankaran, S., Maja, J. M., Lee, W. S., Rasmussen, J., and Ehsani, R. (2013). Comparison of two aerial imaging platforms for identification of huanglongbing-infected citrus trees. Computers and Electronics in Agriculture, 91:106-115.
  6. Hiremath, S. A., Van Der Heijden, G. W., Van Evert, F. K., Stein, A., and Ter Braak, C. J. (2014). Laser range finder model for autonomous navigation of a robot in a maize field using a particle filter. Computers and Electronics in Agriculture, 100:41-50.
  7. Kalman, R. E. (1960). A New Approach to Linear Filtering and Prediction Problems. Journal of Basic Engineering, 82(1):35-45.
  8. Pajares, G. (2015). Overview and current status of remote sensing applications based on unmanned aerial vehicles (uavs). Photogrammetric Engineering & Remote Sensing, 81(4):281-329.
  9. Puttemans, S., Vanbrabant, Y., Tits, L., and Goedemé, T. (2016). Automated visual fruit detection for harvest estimation and robotic harvesting. In IPTA2016. IEEE.
  10. Rovira-Más, F., Zhang, Q., and Reid, J. F. (2008). Stereo vision three-dimensional terrain maps for precision agriculture. Computers and Electronics in Agriculture, 60(2):133-143.
  11. Spadaro, D. and Gullino, M. L. (2004). State of the art and future prospects of the biological control of postharvest fruit diseases. International journal of food microbiology, 91(2):185-194.
  12. Stefas, N., Bayram, H., and Isler, V. (2016). Vision-based UAV navigation in orchards. IFAC-PapersOnLine, 49(16):10-15.
  13. Verbeke, J., Hulens, D., Ramon, H., Goedemé, T., and De Schutter, J. (2014). The design and construction of a high endurance hexacopter suited for narrow corridors. In Unmanned Aircraft Systems (ICUAS), 2014 International Conference on, pages 543-551. IEEE.
  14. Xue, J., Zhang, L., and Grift, T. E. (2012). Variable field-ofview machine vision based row guidance of an agricultural robot. Computers and Electronics in Agriculture, 84:85-91.
  15. Zarco-Tejada, P. J., Diaz-Varela, R., Angileri, V., and Loudjani, P. (2014). Tree height quantification us-
Download


Paper Citation


in Harvard Style

Hulens D., Vandersteegen M. and Goedemé T. (2017). Real-time Vision-based UAV Navigation in Fruit Orchards . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-225-7, pages 617-622. DOI: 10.5220/0006242906170622


in Bibtex Style

@conference{visapp17,
author={Dries Hulens and Maarten Vandersteegen and Toon Goedemé},
title={Real-time Vision-based UAV Navigation in Fruit Orchards},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={617-622},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006242906170622},
isbn={978-989-758-225-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)
TI - Real-time Vision-based UAV Navigation in Fruit Orchards
SN - 978-989-758-225-7
AU - Hulens D.
AU - Vandersteegen M.
AU - Goedemé T.
PY - 2017
SP - 617
EP - 622
DO - 10.5220/0006242906170622