3D Object Reconstruction with a Single RGB-Depth Image

Silvia Rodríguez-Jiménez, Nicolas Burrus, Mohamed Abderrahim

2013

Abstract

This paper presents a fast method for acquiring 3D models of unknown objects lying on a table, using a single viewpoint. The proposed algorithm is able to reconstruct a full model using a single RGB + Depth image, such as those provided by available low-cost range cameras. It estimates the hidden parts by exploiting the geometrical properties of everyday objects, and combines depth and color information for a better segmentation of the object of interest. A quantitative evaluation on a set of 12 common objects shows that our approach is not only simple and effective, but also the reconstructed model is accurate enough for tasks such as robotic grasping.

References

  1. Bohg, J., Johnson-Roberson, M., León, B., Felip, J., Gratal, X., Bergstrom, N., Kragic, D., and Morales, A. (2011). Mind the gap-robotic grasping under incomplete observation. In Proceedings of the IEEE International Conference on Robotics and Automation, pages 686-693, Shanghai, China.
  2. Boykov, Y. and Jolly, M.-P. (2001). Interactive graph cuts for optimal boundary amp; region segmentation of objects in n-d images. In Proceedings of the IEEE International Conference on Computer Vision, volume 1, pages 105-112, Vancouver, Canada.
  3. Chiu, W., Blanke, U., and Fritz, M. (2011). Improving the kinect by cross-modal stereo. In Proceedings of the British Machine Vision Conference, pages 116.1- 116.10. Dundee, UK.
  4. Diankov, R. (2010). Automated Construction of Robotic Manipulation Programs. PhD thesis, Carnegie Mellon University, Robotics Institute.
  5. Kazhdan, M., Bolitho, M., and Hoppe, H. (2006). Poisson surface reconstruction. In Symposium on Geometry Processing, pages 61-70.
  6. Krainin, M., Curless, B., and Fox, D. (2011). Autonomous generation of complete 3d object models using next best view manipulation planning. In Proceedings of the IEEE International Conference on Robotics and Automation, pages 5031-5037, Shanghai, China.
  7. Krainin, M., Henry, P., Ren, X., and Fox, D. (2010). Manipulator and object tracking for in-hand model acquisition. In Proceedings of the Workshop on Best Practice in 3D Perception and Modeling for Mobile Manipulation at the IEEE International Conference on Robotics and Automation, Anchorage, Alaska.
  8. Kuehnle, J., Xue, Z., Stotz, M., Zoellner, J., Verl, A., and Dillmann, R. (2008). Grasping in depth maps of timeof-flight cameras. In International Workshop on Robotic and Sensors Environments, pages 132-137.
  9. Lombaert, H., Sun, Y., Grady, L., and Xu, C. (2005). A multilevel banded graph cuts method for fast image segmentation. In Proceedings of the IEEE International Conference on Computer Vision, volume 1, pages 259-265, Beijing, China.
  10. Marton, Z., Pangercic, D., Blodow, N., Kleinehellefort, J., and Beetz, M. (2010). General 3d modelling of novel objects from a single view. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 3700-3705.
  11. MeshLab (2011). Visual Computing Lab-ISTI-CNR, <http://meshlab.sourceforge.net/>
  12. Microsoft (2010). Kinect for Xbox 360, <http://www.xbox.com/en-US/kinect/>
  13. Miller, A. and Allen, P. (2004). Graspit! a versatile simulator for robotic grasping. IEEE Robotics Automation Magazine, 11(4):110-122.
  14. Oh, K.-J., Yea, S., and Ho, Y.-S. (2009). Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-d video. In Proceedings of the Picture Coding Symposium, pages 1-4.
  15. Rother, C., Kolmogorov, V., and Blake, A. (2004). "GrabCut": interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics, 23:309- 314.
  16. Rusu, R., Bradski, G., Thibaux, R., and Hsu, J. (2010). Fast 3d recognition and pose using the viewpoint feature histogram. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2155-2162.
  17. Sun, M., Kumar, S. S., Bradski, G., and Savarese, S. (2011). Toward automatic 3d generic object modeling from one single image. In Proceedings of the 3DIMPVT, Hangzhou, China.
  18. Telea, A. (2004). An Image Inpainting Technique Based on the Fast Marching Method. Journal of graphics, gpu, and game tools, 9(1):23-34.
  19. Thomas, A., Ferrari, V., Leibe, B., Tuytelaars, T., and Van Gool, L. (2007). Depth-from-recognition: Inferring meta-data by cognitive feedback. In Proceedings of the IEEE International Conference on Computer Vision, pages 1-8.
  20. Thrun, S. and Wegbreit, B. (2005). Shape from symmetry. In Proceedings of the IEEE International Conference on Computer Vision, volume 2, pages 1824-1831, Beijing, China.
  21. Vaiapury, K., Aksay, A., and Izquierdo, E. (2010). Grabcutd: improved grabcut using depth information. In Proceedings of the ACM workshop on Surreal media and virtual cloning, pages 57-62, New York, NY, USA.
Download


Paper Citation


in Harvard Style

Rodríguez-Jiménez S., Burrus N. and Abderrahim M. (2013). 3D Object Reconstruction with a Single RGB-Depth Image . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-48-8, pages 155-163. DOI: 10.5220/0004286401550163


in Bibtex Style

@conference{visapp13,
author={Silvia Rodríguez-Jiménez and Nicolas Burrus and Mohamed Abderrahim},
title={3D Object Reconstruction with a Single RGB-Depth Image},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={155-163},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004286401550163},
isbn={978-989-8565-48-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013)
TI - 3D Object Reconstruction with a Single RGB-Depth Image
SN - 978-989-8565-48-8
AU - Rodríguez-Jiménez S.
AU - Burrus N.
AU - Abderrahim M.
PY - 2013
SP - 155
EP - 163
DO - 10.5220/0004286401550163