3D Reconstruction with Mirrors and RGB-D Cameras

Abdullah Akay, Yusuf Sinan Akgul

2014

Abstract

RGB-D cameras such as Microsoft's Kinect have found many application areas in robotics, 3D modelling and indoor vision due to their low-costs and ease of use. 3D reconstruction with RGB-D cameras is relatively more convenient because they provide RGB and depth data simultaneously for each image element. However, for a full 3D reconstruction of a scene, a single fixed RGB-D camera is inadequate and using multiple cameras brings many challenges with them, such as bandwidth limitations and synchronization. To overcome these difficulties, we propose a solution that employs mirrors to introduce virtual RGB-D cameras into the system. The proposed system does not have any space limitations, data bandwidth constraints, synchronization problems and it is cheaper because we do not require extra cameras. We develop formulations for the simultaneous calibration of real and virtual RGB and RGB-D cameras and we also provide methods for 3D reconstruction from these cameras. We conduct several experiments to assess our system; numerical and visual results are found satisfying.

References

  1. Smisek, Jan, Michal Jancosek, and Tomas Pajdla. "3D with Kinect." Consumer Depth Cameras for Computer Vision. Springer London, 2013. 3-25.
  2. Henry, Peter, et al. "RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments." The International Journal of Robotics Research 31.5 (2012): 647-663.
  3. Khoshelham, Kourosh, and Sander Oude Elberink. "Accuracy and resolution of kinect depth data for indoor mapping applications." Sensors 12.2 (2012): 1437-1454.
  4. Izadi, Shahram, et al. "KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera." Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 2011.
  5. Rusu, Radu Bogdan, and Steve Cousins. "3d is here: Point cloud library (pcl)."Robotics and Automation (ICRA), 2011 IEEE International Conference on. IEEE, 2011.
  6. Canessa, Andrea, et al. "Calibrated depth and color cameras for accurate 3D interaction in a stereoscopic augmented reality environment." Journal of Visual Communication and Image Representation (2013).
  7. Oliver, Ayrton, et al. "Using the Kinect as a navigation sensor for mobile robotics." Proceedings of the 27th Conference on Image and Vision Computing New Zealand. ACM, 2012.
  8. Lai, Kevin, et al. "A large-scale hierarchical multi-view rgb-d object dataset."Robotics and Automation (ICRA), 2011 IEEE International Conference on. IEEE, 2011.
  9. Hossny, M., et al. "Low cost multimodal facial recognition via kinect sensors."LWC 2012: Potent land force for a joint maritime strategy: Proceedings of the 2012 Land Warfare Conference. Commonwealth of Australia.
  10. Schröder, Y., Scholz, A., Berger, K., Ruhl, K., Guthe, S., & Magnor, M. (2011). Multiple kinect studies. Computer Graphics.
  11. Butler, D. Alex, et al. "Shake'n'sense: reducing interference for overlapping structured light depth cameras." Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems. ACM, 2012.
  12. Nene, Sameer A., and Shree K. Nayar. "Stereo with mirrors." Computer Vision, 1998. Sixth International Conference on. IEEE, 1998.
  13. Mariottini, Gian Luca, et al. "Planar mirrors for imagebased robot localization and 3-D reconstruction." Mechatronics 22.4 (2012): 398-409.
  14. "Kinect vs. Mirror," http://www.youtube.com/watch?v=1Qx8NzuSSJ4 Zhang, Z. 2000. A flexible new technique for camera calibration. IEEE TPAMI, 22(11):1330-1334.
  15. Jones, Brett R. Augmenting Complex Surfaces With Projector-Camera Systems. Diss. University of Illinois, 2011.
  16. Besl, Paul J., and Neil D. McKay. "Method for registration of 3-D shapes." Robotics-DL tentative. International Society for Optics and Photonics, 1992.
Download


Paper Citation


in Harvard Style

Akay A. and Akgul Y. (2014). 3D Reconstruction with Mirrors and RGB-D Cameras . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-009-3, pages 325-334. DOI: 10.5220/0004676303250334


in Bibtex Style

@conference{visapp14,
author={Abdullah Akay and Yusuf Sinan Akgul},
title={3D Reconstruction with Mirrors and RGB-D Cameras},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={325-334},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004676303250334},
isbn={978-989-758-009-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)
TI - 3D Reconstruction with Mirrors and RGB-D Cameras
SN - 978-989-758-009-3
AU - Akay A.
AU - Akgul Y.
PY - 2014
SP - 325
EP - 334
DO - 10.5220/0004676303250334