Reactive Reaching and Grasping on a Humanoid - Towards Closing the Action-Perception Loop on the iCub

Jürgen Leitner, Mikhail Frank, Alexander Förster, Jürgen Schmidhuber

2014

Abstract

We propose a system incorporating a tight integration between computer vision and robot control modules on a complex, high-DOF humanoid robot. Its functionality is showcased by having our iCub humanoid robot pick-up objects from a table in front of it. An important feature is that the system can avoid obstacles – other objects detected in the visual stream – while reaching for the intended target object. Our integration also allows for non-static environments, i.e. the reaching is adapted on-the-fly from the visual feedback received, e.g. when an obstacle is moved into the trajectory. Furthermore we show that this system can be used both in autonomous and tele-operation scenarios.

References

  1. Ambrose, R., Wilcox, B., Reed, B., Matthies, L., Lavery, D., and Korsmeyer, D. (2012). Robotics, tele-robotics, and autonomous systems roadmap. Technical report, NASA.
  2. Bay, H., Tuytelaars, T., and Van Gool, L. (2006). Surf: Speeded up robust features. Computer Vision - ECCV 2006, pages 404-417.
  3. Bradski, G. (2000). The OpenCV Library. Dr. Dobb's Journal of Software Tools.
  4. Brooks, R. (1991). Intelligence without representation. Artificial intelligence, 47(1):139-159.
  5. Carbone, G. (2013). Grasping in robotics, volume 10 of Mechanisms and Machine Science. Springer.
  6. Chaumette, F. and Hutchinson, S. (2006). Visual servo control, part i: Basic approaches. IEEE Robotics & Automation Magazine, 13(4):82-90.
  7. Cipolla, R., Battiato, S., and Farinella, G. M. (2010). Computer Vision: Detection, Recognition and Reconstruction, volume 285. Springer.
  8. Corke, P. (2011). Robotics, Vision and Control, volume 73 of Springer Tracts in Advanced Robotics. Springer.
  9. Davison, A. J. and Murray, D. W. (2002). Simultaneous localization and map-building using active vision. IEEE Trans. on Pattern Analysis and Machine Intelligence, 24(7):865-880.
  10. De Santis, A., Albu-Schaffer, A., Ott, C., Siciliano, B., and Hirzinger, G. (2007). The skeleton algorithm for selfcollision avoidance of a humanoid manipulator. In Proc. of the IEEE/ASME International Conferenced on Advanced Intelligent Mechatronics.
  11. Dietrich, A., Wimbock, T., Taubig, H., Albu-Schaffer, A., and Hirzinger, G. (2011). Extensions to reactive selfcollision avoidance for torque and position controlled humanoids. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA).
  12. Forssberg, H., Eliasson, A., Kinoshita, H., Johansson, R., and Westling, G. (1991). Development of human precision grip i: basic coordination of force. Experimental Brain Research, 85(2):451.
  13. Frank, M., Leitner, J., Stollenga, M., Frster, A., and Schmidhuber, J. (2014). Curiosity driven reinforcement learning for motion planning on humanoids. Frontiers in Neurorobotics, 7(25).
  14. Frank, M., Leitner, J., Stollenga, M., Harding, S., Förster, A., and Schmidhuber, J. (2012). The modular behavioral environment for humanoids and other robots (MoBeE). In Proc. of the Int'l. Conf. on Informatics in Control, Automation & Robotics (ICINCO).
  15. Harding, S., Leitner, J., and Schmidhuber, J. (2013). Cartesian genetic programming for image processing. In Riolo, R., Vladislavleva, E., Ritchie, M. D., and Moore, J. H., editors, Genetic Programming Theory and Practice X, Genetic and Evolutionary Computation, pages 31-44. Springer New York.
  16. Hartley, R. and Zisserman, A. (2000). Multiple view geometry in computer vision. Cambridge Univ Press.
  17. Hudson, N., Howard, T., Ma, J., Jain, A., Bajracharya, M., Myint, S., Kuo, C., Matthies, L., Backes, P., Hebert, P., Fuchs, T., and Burdick, J. (2012). End-to-end dexterous manipulation with deliberate interactive estimation. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA).
  18. Karlsson, N., Di Bernardo, E., Ostrowski, J., Goncalves, L., Pirjanian, P., and Munich, M. (2005). The vSLAM Algorithm for Robust Localization and Mapping. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA).
  19. Kemp, C., Edsinger, A., and Torres-Jara, E. (2007). Challenges for robot manipulation in human environments [grand challenges of robotics]. IEEE Robotics & Automation Magazine, 14(1).
  20. Khatib, O. (1986). Real-time obstacle avoidance for manipulators and mobile robots. The international journal of robotics research, 5(1):90.
  21. Kragic, D. and Vincze, M. (2009). Vision for robotics. Foundations and Trends in Robotics, 1(1):1-78.
  22. LaValle, S. (2006). Planning algorithms. Cambridge Univ Pr.
  23. Leitner, J., Chandrashekhariah, P., Harding, S., Frank, M., Spina, G., Forster, A., Triesch, J., and Schmidhuber, J. (2012a). Autonomous learning of robust visual object detection and identification on a humanoid. In Proc. of the IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL).
  24. Leitner, J., Harding, S., Frank, M., Förster, A., and Schmidhuber, J. (2012b). icVision: A Modular Vision System for Cognitive Robotics Research. In Proc. of the International Conference on Cognitive Systems (CogSys).
  25. Leitner, J., Harding, S., Frank, M., Förster, A., and Schmidhuber, J. (2012c). Learning spatial object localisation from vision on a humanoid robot. International Journal of Advanced Robotic Systems, 9.
  26. Leitner, J., Harding, S., Frank, M., Förster, A., and Schmidhuber, J. (2012d). Transferring spatial perception between robots operating in a shared workspace. In Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  27. Lowe, D. (1999). Object Recognition from Local ScaleInvariant Features. In Proc. of the International Conference on Computer Vision.
  28. Maitin-Shepard, J., Cusumano-Towner, M., Lei, J., and Abbeel, P. (2010). Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding. In Proc. of the IEEE International Conference on Robotics and Automation (ICRA).
  29. Metta, G., Fitzpatrick, P., and Natale, L. (2006). YARP: Yet Another Robot Platform. International Journal of Advanced Robotic Systems, 3(1).
  30. Metta, G., Natale, L., Nori, F., Sandini, G., Vernon, D., Fadiga, L., von Hofsten, C., Rosander, K., Lopes, M., Santos-Victor, J., Bernardino, A., and Montesano, L. (2010). The iCub humanoid robot: An open-systems platform for research in cognitive development. Neural Networks, 23(8-9):1125-1134.
  31. Panin, G., Ladikos, A., and Knoll, A. (2006). An efficient and robust real-time contour tracking system. In Proc. of the IEEE International Conference on Computer Vision Systems.
  32. Pathak, S., Pulina, L., Metta, G., and Tacchella, A. (2013). Ensuring safety of policies learned by reinforcement: Reaching objects in the presence of obstacles with the icub. In Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  33. Pattacini, U. (2011). Modular Cartesian Controllers for Humanoid Robots: Design and Implementation on the iCub. PhD thesis, Italian Institute of Technology, Genova.
  34. Plumert, J. and Spencer, J. (2007). The emerging spatial mind. Oxford University Press, USA.
  35. Saxena, A., Driemeyer, J., and Ng, A. (2008). Robotic grasping of novel objects using vision. The International Journal of Robotics Research (IJRR), 27(2):157.
  36. Schoner, G. and Dose, M. (1992). A dynamical systems approach to task-level system integration used to plan and control autonomous vehicle motion. Robotics and Autonomous Systems, 10(4):253-267.
  37. Stollenga, M., Pape, L., Frank, M., Leitner, J., Fo˜rster, A., and Schmidhuber, J. (2013). Task-relevant roadmaps: A framework for humanoid motion planning. In Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  38. Stückler, J., Badami, I., Droeschel, D., Gräve, K., Holz, D., McElhone, M., Nieuwenhuisen, M., Schreiber, M., Schwarz, M., and Behnke, S. (2013). Nimbro@home: Winning team of the robocup@home competition 2012. In Robot Soccer World Cup XVI, pages 94-105. Springer.
  39. Tsagarakis, N., Metta, G., Sandini, G., Vernon, D., Beira, R., Becchi, F., Righetti, L., Santos-Victor, J., Ijspeert, A., Carrozza, M., and Caldwell, D. (2007). iCub: the design and realization of an open humanoid platform for cognitive and neuroscience research. Advanced Robotics, 21:1151-1175.
  40. Vahrenkamp, N., Wieland, S., Azad, P., Gonzalez, D., Asfour, T., and Dillmann, R. (2008). Visual servoing for humanoid grasping and manipulation tasks. In Proc. of the IEEE International Conference on Humanoid Robots, pages 406-412.
Download


Paper Citation


in Harvard Style

Leitner J., Frank M., Förster A. and Schmidhuber J. (2014). Reactive Reaching and Grasping on a Humanoid - Towards Closing the Action-Perception Loop on the iCub . In Proceedings of the 11th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-758-039-0, pages 102-109. DOI: 10.5220/0005113401020109


in Bibtex Style

@conference{icinco14,
author={Jürgen Leitner and Mikhail Frank and Alexander Förster and Jürgen Schmidhuber},
title={Reactive Reaching and Grasping on a Humanoid - Towards Closing the Action-Perception Loop on the iCub},
booktitle={Proceedings of the 11th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2014},
pages={102-109},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005113401020109},
isbn={978-989-758-039-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - Reactive Reaching and Grasping on a Humanoid - Towards Closing the Action-Perception Loop on the iCub
SN - 978-989-758-039-0
AU - Leitner J.
AU - Frank M.
AU - Förster A.
AU - Schmidhuber J.
PY - 2014
SP - 102
EP - 109
DO - 10.5220/0005113401020109