Hand-eye Calibration with a Depth Camera: 2D or 3D?

Svenja Kahn, Dominik Haumann, Volker Willert

2014

Abstract

Real time 3D imaging applications such as on the fly 3D inspection or 3D reconstruction can be created by rigidly coupling a depth camera with an articulated measurement arm or a robot. For such applications, the "hand-eye transformation" between the depth camera and the measurement arm needs to be known. For depth cameras, the hand-eye transformation can either be estimated using 2D images or the 3D measurements captured by the depth camera. This paper investigates the comparison between 2D image based and 3D measurement based hand-eye-calibration. First, two hand-eye calibration approaches are introduced which differ in the way the camera pose is estimated (either with 2D or with 3D data). The main problem in view of the evaluation is, that the ground truth hand-eye transformation is not available and thus a direct evaluation of the accuracy is not possible. Therefore, we introduce quantitative 2D and 3D error measures that allow for an implicit evaluation of the accuracy of the calibration without explicitly knowing the real ground truth transformation. In view of 3D precision, the 3D calibration approach provides more accurate results on average but requires more manual preparation and much more computation time than the 2D approach.

References

  1. Besl, P. and McKay, N. (1992). A method for registration of 3-d shapes. In IEEE Trans. on Pattern Analysis and Machine Intell., volume 14(2), pages 239-256.
  2. Kahn, S., Bockholt, U., Kuijper, A., and Fellner, D. W. (2013). Towards precise real-time 3d difference detection for industrial applications. Computers in Industry, pages 1-14.
  3. Kahn, S. and Kuijper, A. (2012). Fusing real-time depth imaging with high precision pose estimation by a measurement arm. In 2012 International Conference on Cyberworlds (CW), pages 256-260.
  4. Kim, D.-W. and Ha, J.-E. (2013). Hand/eye calibration using 3d-3d correspondences. Applied Mechanics and Materials, 319:532-535.
  5. Lepetit, V. and Fua, P. (2006). Keypoint recognition using randomized trees. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(9):1465-1479.
  6. MesaImaging (2009). SR4000 user manual (version 2.0).
  7. Piatti, D. (2011). Time-of-Flight cameras: tests, calibration and multi-frame registration for automatic 3D object reconstruction. PhD thesis, Politecnico di Torino, Italy.
  8. Reinbacher, C., Ruther, M., and Bischof, H. (2012). Ronect: Hand mounted depth sensing using a commodity gaming sensor. In 21st International Conference on Pattern Recognition (ICPR), pages 461-464.
  9. Rusinkiewicz, S. and Levoy, M. (2001). Efficient variants of the ICP algorithm. In Proc. 3rd Intl. Conf. on 3-D Digital Imaging and Modeling, pages 224-231.
  10. Stoyanov, T., Mojtahedzadeh, R., Andreasson, H., and Lilienthal, A. J. (2012). Comparative evaluation of range sensor accuracy for indoor mobile robotics and automated logistics applications. Robotics and Autonomous Systems. Online first 10/2012.
  11. Strobl, K. H. and Hirzinger, G. (2006). Optimal hand-eye calibration. In Proc. of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pages 4647-4653.
  12. Tsai, R. Y. and Lenz, R. K. (1988). A new technique for fully autonomous and efficient 3d robotics hand-eye calibration. In Proc. of the 4th international symposium on Robotics Research 1998, pages 287-297.
  13. Willert, V., Haumann, D., and Hartkopf, S. (2012). Methode zur Hand-Auge-Kalibrierung von 3D-Kameras. EP12190676.2.
Download


Paper Citation


in Harvard Style

Kahn S., Haumann D. and Willert V. (2014). Hand-eye Calibration with a Depth Camera: 2D or 3D? . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-009-3, pages 481-489. DOI: 10.5220/0004668604810489


in Bibtex Style

@conference{visapp14,
author={Svenja Kahn and Dominik Haumann and Volker Willert},
title={Hand-eye Calibration with a Depth Camera: 2D or 3D?},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={481-489},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004668604810489},
isbn={978-989-758-009-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)
TI - Hand-eye Calibration with a Depth Camera: 2D or 3D?
SN - 978-989-758-009-3
AU - Kahn S.
AU - Haumann D.
AU - Willert V.
PY - 2014
SP - 481
EP - 489
DO - 10.5220/0004668604810489