Articulated Object Modeling based on Visual and Haptic Observations

Wei Wang, Vasiliki Koropouli, Dongheui Lee, Kolja Kühnlenz

2013

Abstract

Manipulation of articulated objects constitutes an important and hard challenge for robots. This paper proposes an approach to model articulated objects by integrating visual and haptic information. Line-shaped skeletonization based on depth image data is realized to extract the skeleton of an object given different configurations. Using observations of the extracted object’s skeleton topology, the kinematic joints of the object are characterized and localized. Haptic data in the form of task-space force required to manipulate the object, are collected by kinesthetic teaching and learned by Gaussian Mixture Regression in object joint state space. Following modeling, manipulation of the object is realized by first identifying the current object joint states from visual observations and second generalizing learned force to accomplish the new task.

References

  1. Calinon, S., Guenter, F., and Billard, A. (2007). On learning, representing, and generalizing a task in a humanoid robot. Systems, Man, and Cybernetics, Part B: Cybernetics, 37(2):286-298.
  2. Huang, X., Walker, L., and Birchfield, S. (2012). Occlusion-aware reconstruction and manipulation of 3d articulated objects. In In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), pages 1365-1371, St. Paul, Minnesota.
  3. Kalakrishnan, M., Righetti, L., Pastor, P., and Schaal, S. (2011). Learning force control policies for compliant manipulation. In Intelligent Robots and Systems (IROS), pages 4639-4644.
  4. Katz, D. and Brock, O. (2008). Manipulating articulated objects with interactive perception. In In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), pages 272-277, Pasadena, CA.
  5. Lee, D. and Ott, C. (2011). Incremental kinesthetic teaching of motion primitives using the motion refinement tube. Autonomous Robots, 31(2):115-131.
  6. Lutscher, E., Lawitzky, M., Cheng, G., and Hirche, S. (2010). A control strategy for operating unknown constrained mechanisms. In In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), pages 819-824, Anchorage, Alaska, USA.
  7. Rusu, R. B., Bradski, G., Thibaux, R., and Hsu, J. (2010). Fast 3d recognition and pose using the viewpoint feature histogram. In In Proc. of the International Conference on Intelligent Robot Systems (IROS), pages 2155-2162, Taipei, Taiwan.
  8. Sturm, J., Stachniss, C., and Burgard, W. (2011). A probabilistic framework for learning kinematic models of articulated objects. Journal of Artificial Intelligence Research, 41(2):477-526.
  9. Tagliasacchi, A., Zhang, H., and Cohen-Or., D. (2009). Curve skeleton extraction from incomplete point cloud. In ACM Trans. on Graph, 28(3):71.
  10. Wang, W., Brs?c?ic, D., He, Z., Hirche, S., and Kühnlenz, K. (2011). Real-time human body motion estimation based on multi-layer laser scans. In In Proc. of the International Conference on Ubiquitous Robots and Ambient Intelligence, pages 297-302, Incheon, Korea.
Download


Paper Citation


in Harvard Style

Wang W., Koropouli V., Lee D. and Kühnlenz K. (2013). Articulated Object Modeling based on Visual and Haptic Observations . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-48-8, pages 253-259. DOI: 10.5220/0004280902530259


in Bibtex Style

@conference{visapp13,
author={Wei Wang and Vasiliki Koropouli and Dongheui Lee and Kolja Kühnlenz},
title={Articulated Object Modeling based on Visual and Haptic Observations},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={253-259},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004280902530259},
isbn={978-989-8565-48-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013)
TI - Articulated Object Modeling based on Visual and Haptic Observations
SN - 978-989-8565-48-8
AU - Wang W.
AU - Koropouli V.
AU - Lee D.
AU - Kühnlenz K.
PY - 2013
SP - 253
EP - 259
DO - 10.5220/0004280902530259