Evaluation of Distance-Aware KinFu Algorithm for Stereo Outdoor Data

Hani Javan Hemmat, Egor Bondarev, Gijs Dubbelman, Peter H. N. de With

2014

Abstract

In this paper, we report on experiments on deployment of an extended distance-aware KinFu algorithm, designed to generate 3D model from Kinect data, onto depth frames extracted from stereo camera data. The proposed idea allows to suppress the Kinect usage limitation for outdoor sensing due to the IR interference with sun light. Besides this, exploiting the stereo data enables a hybrid 3D reconstruction system capable of switching between the Kinect depth frames and stereo data depending on the quality and quantity of the 3D and visual features on a scene. While the nature of the stereo sensing and the Kinect depth sensing is completely different, the stereo camera and the Kinect show similar sensitivity to distance capturing. We have evaluated the stereo-based 3D recon- struction with the extended KinFu algorithm with the following distance aware weighting strategies: (a) weight definition to prioritize importance of the sensed data depending on its accuracy, and (b) model updating to decide about the level of influence of the new data on the existing 3D model. The qualitative compari- son of the resulting outdoor 3D models shows higher accuracy and smoothness of models obtained by introduced distance-aware strategies. The quantitative anal- ysis reveals that applying the proposed weighting strategies onto stereo datasets enables to increase robustness of the pose-estimation algorithm and its endurance by factor of two.

References

  1. Bondarev, E., Heredia, F., Favier, R., Ma, L., and de With, P. (2013). On photo-realistic 3d reconstruction of largescale and arbitrary-shaped environments. In Consumer Communications and Networking Conference (CCNC), 2013 IEEE, pages 621-624.
  2. Chow, J., Ang, K., Lichti, D., and Teskey, W. (2012). Performance analysis of a low-cost triangulation-based 3D camera: Microsoft kinect system. In International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XXXIXB5, 2012 XXII ISPRS Congress, Melbourne, Australia.
  3. Curless, B. and Levoy, M. (1996). A volumetric method for building complex models from range images. In CM SIGGRAPH Conf. Proceedings, pp. 303-312 (1996).
  4. Engelhard, N., Endres, F., Hess, J., Strum, J., and Burgard, W. (2011). Real-time 3d visual slam with a hand-held camera. In RGB-D Workshop on 3D Perception in Robotics, European Robotics Forum.
  5. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. (2011). Kinectfusion: Real-time 3d reconstruction and interaction using a moving depth camera. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST 7811, pages 559-568, New York, NY, USA. ACM.
  6. Javan Hemmat, H., Bondarev, E., and de With, P. (2014a). Exploring distance-aware weighting strategies for accurate reconstruction of voxel-based 3d synthetic models. In MMM'14 Proceedings of Multi-Media Modelling 2014 (will be presented) (2014).
  7. Javan Hemmat, H., Bondarev, E., Dubbelman, G., and de With, P. (2014b). Improved icp-based pose estimation by distance-aware 3d mapping. In VISAPP'14, Proceedings of 9th International Conference on Computer Vision Theory and Application (will be presented) 2014.
  8. Khoshelham, K. (2011). Accuracy analysis of kinect depth data. In ISPRS workshop laser scanning / ed. by D.D. Lichti and A.F. Habib., IAPRS XXXVIII-5/W12 (2011).
  9. Khoshelham, K. and Elberink, S. O. (2012). Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors, 12(2):1437-1454.
  10. Newcombe, R., Lovegrove, S., and Davison, A. (2011a). Dense tracking and mapping in real-time. In ICCV'11, IEEE International Conference on Computer Vision, Spain.
  11. Newcombe, R. A., Davison, A. J., Izadi, S., Kohli, P., Hilliges, O., Shotton, J., Molyneaux, D., Hodges, S., Kim, D., and Fitzgibbon, A. (2011b). Kinectfusion: Real-time dense surface mapping and tracking. In Mixed and Augmented Reality (ISMAR), 2011 10th IEEE International Symposium on, pages 127-136.
  12. PCL (2011). Kinectfusion implementation in the PCL. http://svn.pointclouds.org/pcl/trunk/.
  13. Steinbrucker, F., Sturm, J., and Cremers, D. (2011). Realtime visual odometry from dense rgb-d images. In IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pages 719-722.
  14. Whelan, T., Johannsson, H., Kaess, M., Leonard, J., and McDonald, J. (2012a). Robust tracking for real-time dense rgb-d mapping with kintinuous. In MIT technical report, MIT-CSAIL-TR-2012-031.
  15. Whelan, T., Johannsson, H., Kaess, M., Leonard, J., and McDonald, J. (2013). Robust real-time visual odometry for dense RGB-D mapping. In IEEE Intl. Conf. on Robotics and Automation, ICRA, Karlsruhe, Germany.
  16. Whelan, T., Kaess, M., Fallon, M., Johannsson, H., Leonard, J., and McDonald, J. (2012b). Kintinuous: Spatially extended kinectfusion. In RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras, Sydney, Australia.
Download


Paper Citation


in Harvard Style

Javan Hemmat H., Bondarev E., Dubbelman G. and de With P. (2014). Evaluation of Distance-Aware KinFu Algorithm for Stereo Outdoor Data . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: PANORAMA, (VISIGRAPP 2014) ISBN 978-989-758-004-8, pages 746-751. DOI: 10.5220/0004901507460751


in Bibtex Style

@conference{panorama14,
author={Hani Javan Hemmat and Egor Bondarev and Gijs Dubbelman and Peter H. N. de With},
title={Evaluation of Distance-Aware KinFu Algorithm for Stereo Outdoor Data},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: PANORAMA, (VISIGRAPP 2014)},
year={2014},
pages={746-751},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004901507460751},
isbn={978-989-758-004-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: PANORAMA, (VISIGRAPP 2014)
TI - Evaluation of Distance-Aware KinFu Algorithm for Stereo Outdoor Data
SN - 978-989-758-004-8
AU - Javan Hemmat H.
AU - Bondarev E.
AU - Dubbelman G.
AU - de With P.
PY - 2014
SP - 746
EP - 751
DO - 10.5220/0004901507460751