TOWARDS AUTOMATED CROP YIELD ESTIMATION - Detection and 3D Reconstruction of Pineapples in Video Sequences

Supawadee Chaivivatrakul, Jednipat Moonrinta, Matthew N. Dailey

2010

Abstract

Towards automation of crop yield estimation for pineapple fields, we present a method for detection and 3D reconstruction of pineapples from a video sequence acquired, for example, by a mobile field robot. The detection process incorporates the Harris corner detector, the SIFT keypoint descriptor, and keypoint classification using a SVM. The 3D reconstruction process incorporates structure from motion to obtain a 3D point cloud representing patches of the fruit's surface followed by least squares estimation of the quadric (in this case an ellipsoid) best fitting the 3D point cloud. We performed three experiments to establish the feasibility of the method. Experiments 1 and 2 tested the performance of the Harris, SIFT, and SVM method on indoor and outdoor data. The method achieved a keypoint classification accuracy of 87.79% on indoor data and 76.81% on outdoor data, against base rates of 81.42% and 53.83%, respectively. In Experiment 3, we performed 3D reconstruction from indoor data. The method achieved an average of 34.96% error estimating the ratio of the fruits' major axis to short axis length. Future work will focus on increasing the robustness and accuracy of the 3D reconstruction method as well as resolving the 3D scale ambiguity.

References

  1. Bay, H., Ess, A., Tuytelaars, T., and Van Gool, L. (2008). Speeded-Up Robust Features (SURF). Computer Vision and Image Understanding, 110:346-359.
  2. Chang, C.-C. and Lin, C.-J. (2001). brary for support vector machines. http://www.csie.ntu.edu.tw/ cjlin/libsvm.
  3. Harris, C. and Stephens, M. (1988). A combined corner and edge detector. In Proceedings of The Fourth Alvey Vision Conference, pages 147-151.
  4. Hartley, R. and Zisserman, A. (2004). Multiple view geometry in computer vision. Cambridge University Press, second edition.
  5. Kovesi, P. (2000). MATLAB and Octave functions for computer vision and image processing. School of Computer Science & Software Engineering,The University of Western Australia. Available at http://www.csse.uwa.edu.au/ pk/research/matlabfns/.
  6. Li, Q. and Griffiths, J. G. (2004). Least squares ellipsoid specific fitting. In Proceedings of the Geometric Modeling and Processing Conference. IEEE Computer Society.
  7. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60:91-110.
  8. Pollefeys, M., van Gool, L., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., and Koch, R. (2004). Visual modeling with a hand-held camera. International Journal of Computer Vision, V59.
  9. Strandmark, P. (2008). SURFmex [open source software]. Available at http://www.maths.lth.se/matematiklth/ personal/petter/surfmex.php.
  10. The Mathworks (2007). Image processing toolbox user's guide. Technical report.
  11. Vedaldi, A. (2006). An implementation of SIFT detector and descriptor. Available at http://www.vlfeat.org/ vedaldi/assets/sift/sift.pdf.
Download


Paper Citation


in Harvard Style

Chaivivatrakul S., Moonrinta J. and N. Dailey M. (2010). TOWARDS AUTOMATED CROP YIELD ESTIMATION - Detection and 3D Reconstruction of Pineapples in Video Sequences . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2010) ISBN 978-989-674-028-3, pages 180-183. DOI: 10.5220/0002838201800183


in Bibtex Style

@conference{visapp10,
author={Supawadee Chaivivatrakul and Jednipat Moonrinta and Matthew N. Dailey},
title={TOWARDS AUTOMATED CROP YIELD ESTIMATION - Detection and 3D Reconstruction of Pineapples in Video Sequences},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2010)},
year={2010},
pages={180-183},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002838201800183},
isbn={978-989-674-028-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2010)
TI - TOWARDS AUTOMATED CROP YIELD ESTIMATION - Detection and 3D Reconstruction of Pineapples in Video Sequences
SN - 978-989-674-028-3
AU - Chaivivatrakul S.
AU - Moonrinta J.
AU - N. Dailey M.
PY - 2010
SP - 180
EP - 183
DO - 10.5220/0002838201800183