Robust and Fast Teat Detection and Tracking in Low-resolution Videos for Automatic Milking Devices

Matthew van der Zwan, Alexandru Telea

2015

Abstract

We present a system for detection and tracking of cow teats, as part of the construction of automatic milking devices (AMDs) in the dairy industry. We detail algorithmic solutions for the robust detection and tracking of teat tips in low-resolution video streams produced by embedded time-of-flight cameras, using a combination of depth images and point-cloud data. We present a visual analysis tool for the validation and optimization of the proposed techniques. Compared to existing state-of-the-art solutions, our method can robustly handle occlusions, variable poses, and geometries of the tracked shape, and yields a correct tracking rate for over 90% for tests involving real-world images obtained from an industrial AMD robot.

References

  1. Agarwal, A. and Triggs, B. (2006). Recovering 3D human pose from monocular images. IEEE TPAMI, 28(1):44-58.
  2. Baya, H., Essa, A., Tuytelaars, T., and Gool, L. V. (2008). Speeded up robust features. CVIU, 110(3):346-359.
  3. Chen, D., Farag, A., Falk, R., and Dryden, G. (2009). A variational framework for 3D colonic polyp visualization in virtual colonoscopy. In Proc. IEEE ICIP, pages 2617-2620.
  4. Dey, T. and Goswami, S. (2004). Provable surface reconstruction from noisy samples. In Proc. SCG, pages 428-438.
  5. Dey, T., Li, K., Ramos, E., and Wenger, R. (2009). Isotopic reconstruction of surfaces with boundaries. CGF, 28(5):1371-1382.
  6. Distante, C., Diraco, G., and Leone, A. (2010). Active range imaging dataset for indoor surveillance. Ann. BMVA, 21(3):1-16.
  7. Dorrington, A., Payne, A., and Cree, M. (2010). An evaluation of time-of-flight range cameras for close range metrology applications. ISPRS J. Photogramm., 38(5):201-206.
  8. Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., and Stuetzle, W. (1992). Surface reconstruction from unorganized points. Proc. ACM SIGGRAPH, 26(2):71- 78.
  9. Hovinen, M., Aisla, A., and Pyörälä, S. (2005). Visual detection of technical success and effectiveness of teat cleaning in two automatic milking systems. J. Dairy Sci., (88):3354-3362.
  10. Hunt, A. (2006). Teat detection for an automatic milking system. In MSc thesis, Univ.
  11. of Dublin, Ireland. doras.dcu.ie/17194/1/ aidan hunt duffy 20120703135817.pdf.
  12. Kazhdan, M., Bolitho, M., and Hoppe, H. (2006). Poisson surface reconstruction. In Proc. SGP, pages 61-70.
  13. Kustra, J., Jalba, A., and Telea, A. (2014). Robust segmentation of multiple intersecting manifolds from unoriented noisy point clouds. CGF, 33(1):73-87.
  14. Lazaros, N., Sirakoulis, G., and Gasteratos, A. (2008). Review of stereo vision algorithms: From software to hardware. Int. J. Optomechatronics, 2:435-462.
  15. LMI Technologies (2012). Time of flight imaging enables automated milking. www.lmi3d.com.
  16. Lowe, D. (2004). Distinctive image features from scaleinvariant keypoints. IJCV, 60(2):91-110.
  17. Mesa Imaging (2010). SR4000 user manual. www.mesaimaging.ch/prodview4k.php.
  18. MESA Imaging (2014). Automatic milking systems. www.mesa-imaging.ch/applications/ automatic-milking-systems.
  19. OpenCV (2014). OpenCV library. www.opencv.org.
  20. Scott Milktech Ltd. (2013). World's first automatic milking system. scott.co.nz/scott-milktech.
  21. Shneiderman, B. (1996). The eyes have it: A task by data type taxonomy for information visualizations. In Proc. IEEE Symp. Vis. Lang., pages 336-343.
  22. Sminchisescu, C. and Triggs, B. (2001). Covariance scaled sampling for monocular 3D body tracking. In Proc. IEEE CVPR, pages 447-454.
  23. Sussman, M. and Wright, G. (1999). The correlation coefficient technique for pattern matching. In Proc. ISMRM, page 203.
  24. Westberg, M. (2009). Time of flight based teat detection. In Tech. Report LiTH-ISY-EX-09/4154- SE, Univ. of Linköping, Sweden. liu.divaportal.org/smash/get/diva2:224321/FULLTEXT01.pdf.
  25. Westin, C., Peled, S., Gubjartsson, H., Kikinis, R., and Jolesz, F. (1997). Geometrical diffusion measures for MRI from tensor basis analysis. In Proc. ISMRM, pages 17-42.
  26. Yuille, A., Hallinan, P., and Cohen, D. (1992). Feature extraction from faces using deformable templates. IJCV, 8(2):99-111.
Download


Paper Citation


in Harvard Style

van der Zwan M. and Telea A. (2015). Robust and Fast Teat Detection and Tracking in Low-resolution Videos for Automatic Milking Devices . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-091-8, pages 520-530. DOI: 10.5220/0005299205200530


in Bibtex Style

@conference{visapp15,
author={Matthew van der Zwan and Alexandru Telea},
title={Robust and Fast Teat Detection and Tracking in Low-resolution Videos for Automatic Milking Devices},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={520-530},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005299205200530},
isbn={978-989-758-091-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)
TI - Robust and Fast Teat Detection and Tracking in Low-resolution Videos for Automatic Milking Devices
SN - 978-989-758-091-8
AU - van der Zwan M.
AU - Telea A.
PY - 2015
SP - 520
EP - 530
DO - 10.5220/0005299205200530