HIGH RESOLUTION POINT CLOUD GENERATION FROM KINECT AND HD CAMERAS USING GRAPH CUT

Suvam Patra, Brojeshwar Bhowmick, Subhashis Banerjee, Prem Kalra

Abstract

This paper describes a methodology for obtaining a high resolution dense point cloud using Kinect (Smisek et al., 2011) and HD cameras. Kinect produces a VGA resolution photograph and a noisy point cloud. But high resolution images of the same scene can easily be obtained using additional HD cameras. We combine the information to generate a high resolution dense point cloud. First, we do a joint calibration of Kinect and the HD cameras using traditional epipolar geometry (Hartley and Zisserman, 2004). Then we use the sparse point cloud obtained from Kinect and the high resolution information from the HD cameras to produce a dense point cloud in a registered frame using graph cut optimization. Experimental results show that this approach can significantly enhance the resolution of the Kinect point cloud.

References

  1. Alexa, M. and Behr, J. (2003). Computing and rendering point set surfaces. In IEEE Transactions on Visualization and Computer Graphics.
  2. Boykov, Y. and Kolmogorov, V. (2004). An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. In IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, No. 9, pages 1124-1137.
  3. Boykov, Y., Veksler, O., and Zabih, R. (2001). Fast approximate energy minimization via graph cuts. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, pages 1222-1239.
  4. Diebel, J. and Thrun, S. (2006). An application of markov random fields to range sensing. in advances in neural information processing. In Advances in Neural Information Processing Systems, page 291 298.
  5. Hartley, R. and Zisserman, A. (2004). Multiple View Geometry in Computer Vision. Cambridge University Press, New York, 2nd edition.
  6. Kolmogorov, V. and Zabih, R. (2004). What energy functions can be minimized via graph cuts? In IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 147-159.
  7. Kutulakos, K. and Seitz, S. (1999). A theory of shape by space carving. In 7th IEEE International Conference on Computer Vision, volume I, page 307 314.
  8. Morel, J.-M. and Yu, G. (2009). Asift: A new framework for fully affine invariant image comparison. In SIAM Journal on Imaging Sciences. Volume 2 Issue 2.
  9. Qingxiong Yang, Ruigang Yang, J. D. and Nistr, D. (2007). Spatial-depth super resolution for range images. In IEEE Conference on Computer Vision and Pattern Recognition.
  10. Schuon, S., Theobalt, C., Davis, J., and Thrun, S. (2008). High-quality scanning using time-of-flight depth superresolution. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.
  11. Schuon, S., Theobalt, C., Davis, J., and Thrun, S. (2009). Lidarboost depth superresolution for tof 3d shape scanning. In IEEE Conference on Computer Vision and Pattern Recognition.
  12. Slabaugh, G. and Schafer, R. (2003). Methods for volumetric reconstruction of visual scenes. In IJCV 2003.
  13. Smisek, J., Jancosek, M., and Pajdla, T. (2011). 3d with kinect. In IEEE Workshop on Consumer Depth Cameras for Computer Vision.
  14. Zhang, Z. (2000). A flexible new technique for camera calibration. In IEEE Transactions On Pattern Analysis And Machine Intelligence, VOL. 22, NO. 11.
Download


Paper Citation


in Harvard Style

Patra S., Bhowmick B., Banerjee S. and Kalra P. (2012). HIGH RESOLUTION POINT CLOUD GENERATION FROM KINECT AND HD CAMERAS USING GRAPH CUT . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-04-4, pages 311-316. DOI: 10.5220/0003863003110316


in Bibtex Style

@conference{visapp12,
author={Suvam Patra and Brojeshwar Bhowmick and Subhashis Banerjee and Prem Kalra},
title={HIGH RESOLUTION POINT CLOUD GENERATION FROM KINECT AND HD CAMERAS USING GRAPH CUT},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={311-316},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003863003110316},
isbn={978-989-8565-04-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)
TI - HIGH RESOLUTION POINT CLOUD GENERATION FROM KINECT AND HD CAMERAS USING GRAPH CUT
SN - 978-989-8565-04-4
AU - Patra S.
AU - Bhowmick B.
AU - Banerjee S.
AU - Kalra P.
PY - 2012
SP - 311
EP - 316
DO - 10.5220/0003863003110316