Calibration and 3D Ground Truth Data Generation with Orthogonal Camera-setup and Refraction Compensation for Aquaria in Real-time

Klaus Müller, Jens Schlemper, Lars Kuhnert, Klaus-Dieter Kuhnert

2014

Abstract

In this paper we present a novel approach to generate precise 3D ground-truth data considering the refraction of the fish tank. We used an accurate and easy-to-handle calibration method to calibrate two orthogonally aligned high-resolution cameras in real-time. For precise fish shape segmentation we combined two different background subtraction algorithms, which can also be trained while fish are swimming inside the aquarium. The presented approach takes also shadow segmentation removal and mirroring into account. For refraction compensation at the air-water border we developed an algorithm which calculates the ray-deflection of every shape-pixel and compute the 3D-model in real-time.

References

  1. Bouguet, J.-Y. (2004). Camera calibration toolbox for matlab. http://www.vision.caltech.edu/bouguetj/calibdoc/ [26.08.2013].
  2. Butail, S. and Paley, D. A. (2012). Three-dimensional reconstruction of fast-start swimming kinematics of densely schooling fish. Journal of The Royal Society Interface, 9:77-88.
  3. Delcourt, J., Denoel, M., Ylieff, M., and Poncin, P. (2012). Video multitracking of fish behaviour: a synthesis and future perspectives. Fish and Fisheries, 14:186-204.
  4. Fontaine, E., Lentink, D., Kranenbarg, S., Mueller, U. K., van Leeuwen, J. L., Barr, A. H., and Burdick, J. W. (2008). Automated visual tracking for studying the ontogeny of zebrafish swimming. Journal of Experimental Biology, 211:1305-1316.
  5. Gao, X. S., Hou, X. R., Tang, J., and Cheng, H. F. (2003). Complete solution classification for the perspectivethree-point problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(8):930-943.
  6. Kim, K., Chalidabhongse, T. H., Harwood, D., and Davis, L. (2005). Real-time foreground-background segmentation using codebook model. Real-Time Imaging, 11(3):172-185.
  7. Kuhnert, L., Thamke, S., Ax, M., Nguyen, D., and Kuhnert, K.-D. (2012). Cooperation in heterogeneous groups of autonomous robots. International Conference on Mechatronics and Automation (ICMA) IEEE, pages 1710-1715.
  8. Laurel, B. J., Laurel, C. J., Brown, J. A., and Gregory, R. S. (2005). A new technique to gather 3d spatial information using a single camera. Journal of Fish Biology, 66:429-441.
  9. Moeller, T. and Trumbore, B. (1997). Fast, minimum storage ray-triangle intersection. Journal of graphics tools, 2.1:21-28.
  10. opencv.org (2013). Opencv - opencv. http://opencv.org/ [01.09.2013].
  11. Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A. Y. (2009). Ros: an open-source robot operating system. In ICRA workshop on open source software, volume 3.
  12. Yamashita, A., Kawanishi, R., Koketsu, T., Kaneko, T., and Asama, H. (2011). Underwater sensing with omnidirectional stereo camera. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference.
  13. ZHANG, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22.11:1330-1334.
  14. Zhu, L. and Weng, W. (2007). Catadioptric stereo-vision system for the real-time monitoring of 3d behaviour in aquatic animals. Physiology & Behavior, 91:106- 119.
  15. Zivkovic, Z. (2004). Improved adaptive gaussian mixture model for background subtraction. In Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, volume 2, pages 28-31. IEEE.
Download


Paper Citation


in Harvard Style

Müller K., Schlemper J., Kuhnert L. and Kuhnert K. (2014). Calibration and 3D Ground Truth Data Generation with Orthogonal Camera-setup and Refraction Compensation for Aquaria in Real-time . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-009-3, pages 626-634. DOI: 10.5220/0004743506260634


in Bibtex Style

@conference{visapp14,
author={Klaus Müller and Jens Schlemper and Lars Kuhnert and Klaus-Dieter Kuhnert},
title={Calibration and 3D Ground Truth Data Generation with Orthogonal Camera-setup and Refraction Compensation for Aquaria in Real-time},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={626-634},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004743506260634},
isbn={978-989-758-009-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)
TI - Calibration and 3D Ground Truth Data Generation with Orthogonal Camera-setup and Refraction Compensation for Aquaria in Real-time
SN - 978-989-758-009-3
AU - Müller K.
AU - Schlemper J.
AU - Kuhnert L.
AU - Kuhnert K.
PY - 2014
SP - 626
EP - 634
DO - 10.5220/0004743506260634