Vision-based Robotic System for Object Agnostic Placing Operations

Nikolaos Rofalis, Lazaros Nalpantidis, Nils Axel Andersen, Volker Krüger

2016

Abstract

Industrial robots are part of almost all modern factories. Even though, industrial robots nowadays manipulate objects of a huge variety in different environments, exact knowledge about both of them is generally assumed. The aim of this work is to investigate the ability of a robotic system to operate within an unknown environment manipulating unknown objects. The developed system detects objects, finds matching compartments in a placing box, and ultimately grasps and places the objects there. The developed system exploits 3D sensing and visual feature extraction. No prior knowledge is provided to the system, neither for the objects nor for the placing box. The experimental evaluation of the developed robotic system shows that a combination of seemingly simple modules and strategies can provide effective solution to the targeted problem.

References

  1. Berg, A. C., Berg, T. L., and Malik, J. (2005). Shape matching and object recognition using low distortion correspondences. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 1, pages 26-33. IEEE.
  2. Brook, P., Ciocarlie, M., and Hsiao, K. (2011). Collaborative grasp planning with multiple object representations. In Robotics and Automation (ICRA), 2011 IEEE International Conference on, pages 2851-2858. IEEE.
  3. Ciocarlie, M. T. and Allen, P. K. (2008). On-line interactive dexterous grasping. In Haptics: Perception, Devices and Scenarios, pages 104-113. Springer.
  4. Detry, R., Ek, C. H., Madry, M., Piater, J., and Kragic, D. (2012). Generalizing grasps across partly similar objects. In IEEE International Conference on Robotics and Automation.
  5. Divvala, S. K., Hoiem, D., Hays, J. H., Efros, A., Hebert, M., et al. (2009). An empirical study of context in object detection. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 1271-1278. IEEE.
  6. Dogar, M. and Srinivasa, S. (2011). A framework for pushgrasping in clutter. Robotics: Science and Systems VII.
  7. Edsinger, A. and Kemp, C. C. (2006). Manipulation in human environments. In Humanoid Robots, 2006 6th IEEE-RAS International Conference on, pages 102- 109. IEEE.
  8. Fisher, M. and Hanrahan, P. (2010). Context-based search for 3d models. In ACM Transactions on Graphics (TOG), volume 29, page 182. ACM.
  9. Flusser, J. (1995). Object matching by means of matching likelihood coefficients. Pattern Recognition Letters, 16(9):893-900.
  10. Fu, H., Cohen-Or, D., Dror, G., and Sheffer, A. (2008). Upright orientation of man-made objects. In ACM transactions on graphics (TOG), volume 27, page 42. ACM.
  11. Glover, J., Bradski, G., and Rusu, R. B. (2012). Monte carlo pose estimation with quaternion kernels and the bingham distribution. In Robotics: science and systems, volume 7, page 97.
  12. Hsiao, K., Nangeroni, P., Huber, M., Saxena, A., and Ng, A. Y. (2009). Reactive grasping using optical proximity sensors. In Robotics and Automation, 2009. ICRA'09. IEEE International Conference on, pages 2098-2105. IEEE.
  13. Jiang, H. and Yu, S. X. (2009). Linear solution to scale and rotation invariant object matching. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 2474-2481. IEEE.
  14. Jiang, Y., Moseson, S., and Saxena, A. (2011). Efficient grasping from rgbd images: Learning using a new rectangle representation. In Robotics and Automation (ICRA), 2011 IEEE International Conference on, pages 3304-3311. IEEE.
  15. Koppula, H. S., Anand, A., Joachims, T., and Saxena, A. (2011). Semantic labeling of 3d point clouds for indoor scenes. In Advances in Neural Information Processing Systems, pages 244-252.
  16. Kouskouridas, R. and Gasteratos, A. (2012). Establishing low dimensional manifolds for 3d object pose estimation. In Imaging Systems and Techniques (IST), 2012 IEEE International Conference on, pages 425-430. IEEE.
  17. Li, H., Kim, E., Huang, X., and He, L. (2010). Object matching with a locally affine-invariant constraint. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 1641-1648. IEEE.
  18. Miller, A. T., Knoop, S., Christensen, H., Allen, P. K., et al. (2003). Automatic grasp planning using shape primitives. In Robotics and Automation, 2003. Proceedings. ICRA'03. IEEE International Conference on, volume 2, pages 1824-1829. IEEE.
  19. Nalpantidis, L., Bj örkman, M., and Kragic, D. (2012). Yesyet another object segmentation: Exploiting camera movement. In Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on, pages 2116-2121. IEEE.
  20. Rietzler, A., Detry, R., Kopicki, M., Wyatt, J. L., and Piater, J. (2013). Inertially-safe grasping of novel objects. In Cognitive Robotics Systems: Replicating Human Actions and Activities (Workshop at IROS 2013).
  21. Sapna Varshney, S., Rajpa, N., and Purwar, R. (2009). Comparative study of image segmentation techniques and object matching using segmentation. In Methods and Models in Computer Science, 2009. ICM2CS 2009. Proceeding of International Conference on, pages 1- 6. IEEE.
  22. Saxena, A., Chung, S. H., and Ng, A. Y. (2008). 3-d depth reconstruction from a single still image. International journal of computer vision, 76(1):53-69.
  23. Saxena, A., Driemeyer, J., Kearns, J., and Ng, A. Y. (2006). Robotic grasping of novel objects. In Advances in neural information processing systems, pages 1209- 1216.
  24. Saxena, A., Driemeyer, J., and Ng, A. Y. (2009). Learning 3-d object orientation from images. In Robotics and Automation, 2009. ICRA'09. IEEE International Conference on, pages 794-800. IEEE.
  25. Schuster, M. J., Okerman, J., Nguyen, H., Rehg, J. M., and Kemp, C. C. (2010). Perceiving clutter and surfaces for object placement in indoor environments. In Humanoid Robots (Humanoids), 2010 10th IEEE-RAS International Conference on, pages 152-159. IEEE.
  26. Suzuki, S. et al. (1985). Topological structural analysis of digitized binary images by border following. Computer Vision, Graphics, and Image Processing, 30(1):32-46.
  27. Toussaint, M., Plath, N., Lang, T., and Jetchev, N. (2010). Integrated motor control, planning, grasping and highlevel reasoning in a blocks world using probabilistic inference. In Robotics and Automation (ICRA), 2010 IEEE International Conference on, pages 385-391. IEEE.
  28. Viola, P. and Jones, M. (2001). Robust real-time object detection. International Journal of Computer Vision, 4:51-52.
  29. Xiong, X. and Huber, D. (2010). Using context to create semantic 3d models of indoor environments. In BMVC, pages 1-11.
Download


Paper Citation


in Harvard Style

Rofalis N., Nalpantidis L., Andersen N. and Krüger V. (2016). Vision-based Robotic System for Object Agnostic Placing Operations . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 465-473. DOI: 10.5220/0005712404650473


in Bibtex Style

@conference{visapp16,
author={Nikolaos Rofalis and Lazaros Nalpantidis and Nils Axel Andersen and Volker Krüger},
title={Vision-based Robotic System for Object Agnostic Placing Operations},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={465-473},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005712404650473},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - Vision-based Robotic System for Object Agnostic Placing Operations
SN - 978-989-758-175-5
AU - Rofalis N.
AU - Nalpantidis L.
AU - Andersen N.
AU - Krüger V.
PY - 2016
SP - 465
EP - 473
DO - 10.5220/0005712404650473