THREE-DIMENISONAL MONOCULAR SCENE RECONSTRUCTION FOR SERVICE-ROBOTS - An Application

Sascha Jockel, Tim Baier-Löwenstein, Jianwei Zhang

Abstract

This paper presents an image based three dimensional reconstruction system for service-robot applications in case of daily table scenarios. Image driven environment perception is one of the main research topics in the field of autonomous robot applications and fundamental for further action-plannings like three dimensional collision detection and prevention for grasping tasks. Perception will be done at two spatial-temporal varying positions by a micro-head camera mounted on a six-degree-of-freedom robot-arm of our mobile service-robot TASER. The epipolar geometry and fundamentalmatrix will be computed by preliminary extracted corners of both input images detected by a Harris-corner- detector. The input images will be rectified using the fundamentalmatrix to align corresponding scanlines together on the same vertical image coordinates. Afterwards a stereo correspondence is accomplished by a fast Birchfield algorithm that provides a 2.5 dimensional depth map of the scene. Based on the depth map a three dimensional textured point-cloud is represented as interactive OpenGL scene model for further action- planning algorithms in three dimensional space.

References

  1. Baier, T., Hueser, M., Westhoff, D., and Zhang, J. (2006). A flexible software architecture for multi-modal service robots. In Multiconference on Computational Engineering in Systems Applications (CESA).
  2. Baier, T. and Zhang, J. (2006). Reusability-based semantics for grasp evaluation in context of service robotics. In IEEE International Conference on Robotics and Biomimetics (ROBIO 2006), Kunming, China.
  3. Birchfield, S. and Tomasi, C. (1996). Depth discontinuities by pixel-to-pixel stereo. Technical report STAN-CSTR-96-1573, Stanford University.
  4. Birchfield, S. and Tomasi, C. (1998). Depth discontinuities by pixel-to-pixel stereo. In Proceedings of the Sixth International Conference on Computer Vision, pages 1073-1080, Bombay, India.
  5. Boykov, Y., Veksler, O., and Zabih, R. (1999). Fast approximate energy minimization via graph cuts. In International Conference on Computer Vision (ICCV), volume 1, pages 377-384.
  6. Chen, S. Y. and Li, Y. F. (2004). Automatic sensor placement for model-based robot vision. In IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics, volume 34, pages 393-408. IEEE Systems, Man, and Cybernetics Society.
  7. Faugeras, O. (1993). Three-dimensional computer vision: a geometric viewpoint. MIT Press, Cambridge, MA, USA.
  8. Fischler, M. A. and Bolles, R. C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. Assoc. Comp. Mach., 24(6):381-395.
  9. Fusiello, A., Trucco, E., and Verri, A. (2000). A compact algorithm for rectification of stereo pairs. Machine Vision and Applications, 12(1):16-22.
  10. Harris, C. and Stephens, M. (1988). A combined corner and edge detector. In Fourth Alvey Vision Conference, pages 147-151.
  11. Hartley, R. I. (1999). Theory and practice of projective rectification. volume 35, pages 115-127. Kluwer Academic Publishers, Hingham, MA, USA.
  12. Hartley, R. I. and Zisserman, A. (2003). Multiple View Geometry in Computer Vision. Camebridge University Press.
  13. C. (2005). Open CV 0.9.7.
  14. Longuet-Higgins, H.-C. (1981). A computer algorithm for reconstructing a scene from two projections. Nature, 293:133-135.
  15. Ma, Y., Soatto, S., Kosecka, J., and Sastry, S. S. (2004). An Invitation to 3-D Vision: From Images to Geometric Models. Springer, Berlin, Heidelberg.
  16. Pollefeys, M. (1999). Self-Calibration and Metric 3D Reconstruction from Uncalibrated Image Sequences. Ph.d. thesis, ESAT-PSI, Katholieke Universiteit Leuven.
  17. Pollefeys, M., Koch, R., Vergauwen, M., and Gool, L. V. (2000). Automated reconstruction of 3d scenes from sequences of images. ISPRS Journal Of Photogrammetry And Remote Sensing, 55:251-267.
  18. Rousseeuw, P. J. and Leroy, A. M. (1987). Robust regression and outlier detection. Wiley, New York.
  19. Trucco, E. and Verri, A. (1998). Introductory Techniques for 3-D Computer Vision. Prentice Hall, New York.
  20. Tsai, R. Y. (1986). An efficient and accurate camera calibration technique for 3d machine vision. In International Conference on Computer Vision and Pattern Recognition, pages 364-374, Miami Beach, Fla. IEEE, IEEE Computer Society Press.
  21. Zhang, Z. (1998). A flexible new technique for camera calibration. Technical report MSR-TR-98-71, Microsoft Research.
Download


Paper Citation


in Harvard Style

Jockel S., Baier-Löwenstein T. and Zhang J. (2007). THREE-DIMENISONAL MONOCULAR SCENE RECONSTRUCTION FOR SERVICE-ROBOTS - An Application . In Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 3: 3D Model Aquisition and Representation, (VISAPP 2007) ISBN 978-972-8865-75-7, pages 41-46. DOI: 10.5220/0002041100410046


in Bibtex Style

@conference{3d model aquisition and representation07,
author={Sascha Jockel and Tim Baier-Löwenstein and Jianwei Zhang},
title={THREE-DIMENISONAL MONOCULAR SCENE RECONSTRUCTION FOR SERVICE-ROBOTS - An Application},
booktitle={Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 3: 3D Model Aquisition and Representation, (VISAPP 2007)},
year={2007},
pages={41-46},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002041100410046},
isbn={978-972-8865-75-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 3: 3D Model Aquisition and Representation, (VISAPP 2007)
TI - THREE-DIMENISONAL MONOCULAR SCENE RECONSTRUCTION FOR SERVICE-ROBOTS - An Application
SN - 978-972-8865-75-7
AU - Jockel S.
AU - Baier-Löwenstein T.
AU - Zhang J.
PY - 2007
SP - 41
EP - 46
DO - 10.5220/0002041100410046