FOOTSTEP PLANNING FOR BIPED ROBOT BASED ON FUZZY Q-LEARNING APPROACH

Christophe Sabourin, Kurosh Madani, Weiwei Yu, Jie Yan

2008

Abstract

The biped robots have more flexible mechanical systems and they can move in more complex environment than wheeled robots. Their abilities to step over both static and dynamic obstacles allow to the biped robots to cross an uneven terrain where ordinary wheeled robots can fail. In this paper we present a footstep planning for biped robots allowing them to step over dynamic obstacles. Our footstep planning strategy is based on a fuzzy Q-learning concept. In comparison with other previous works, one of the most appealing interest of our approach is its good robustness because the proposed footstep planning is operational for both constant and random velocity of the obstacle.

References

  1. M. Hackel. Humanoid Robots: Human-like Machines. ITech Education and Publishing, Vienna, Austria, June 2007 .
  2. A. Carlos, P. Filho. Humanoid Robots: New Developments. I-Tech Education and Publishing, Vienna, Austria, June 2007.
  3. Y. Ayza, K. Munawar, M. B. Malik, A. Konno and M. Uchiyama. A Human-Like Approach to Footstep Planning. Humanoid Robots, I-Tech Education and Publishing, Vienna, Austria, June 2007, pp.296-314
  4. J. Chestnutt, J. J. Kuffner. A Tiered Planning Strategy for Biped Navigation. Int. Conf. on Humanoid Robots (Humanoids'04), Santa Monica, California, 2004.
  5. K. Sabe, M. Fukuchi, J. Gutmann, T. Ohashi, K. Kawamoto, and T. Yoshigahara. Obstacle Avoidance and Path Planning for Humanoid Robots using Stereo Vision. Int. Conf. on Robotics Automation (ICRA). 2004, 592- 597.
  6. J.J. Kuffner, K. Nishiwaki, S. Kagami, M. Inaba, H. Inoue. Footstep Planning Among Obstacles for Biped Robots. Proceedings of IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2001, 500-505.
  7. J.J. Kuffner, K. Nishiwaki, S. Kagami, M. Inaba, H. Inoue. Online Footstep Planning for Humanoid Robots. Proceedings of IEEE/RSJ Int. Conf. on Robotics and Automation (ICRA), 2003, 932-937
  8. J. Chestnutt, M. Lau, G. Cheung, J.J. Kuffner, J. Hodgins, T. Kanade. Footstep Planning for the Honda Asimo Humanoid. Proceedings of IEEE Int. Conf. on Robotics Automation (ICRA), 2005, pp. 629-634
  9. C. Watkins, P. Dayan. Q-learning. Machine Learning, 8, 1992, 279-292.
  10. R.S. Sutton, A.G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
  11. P. Y. Glorennec. Reinforcement Learning: an Overview. European Symposium on Intelligent Techniques (ESIT), 2000,17-35.
  12. P.Y. Glorennec, L. Jouffe. Fuzzy Q-Learning Proc. of FUZZ-IEEE'97, Barcelona, 1997.
  13. L. Jouffe. Fuzzy inference system learning by reinforcement methods. IEEE Trans. on SMC, Part C, August 1998, Vol. 28 (3).
Download


Paper Citation


in Harvard Style

Sabourin C., Madani K., Yu W. and Yan J. (2008). FOOTSTEP PLANNING FOR BIPED ROBOT BASED ON FUZZY Q-LEARNING APPROACH . In Proceedings of the Fifth International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-8111-31-9, pages 183-188. DOI: 10.5220/0001486701830188


in Bibtex Style

@conference{icinco08,
author={Christophe Sabourin and Kurosh Madani and Weiwei Yu and Jie Yan},
title={FOOTSTEP PLANNING FOR BIPED ROBOT BASED ON FUZZY Q-LEARNING APPROACH},
booktitle={Proceedings of the Fifth International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2008},
pages={183-188},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001486701830188},
isbn={978-989-8111-31-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fifth International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - FOOTSTEP PLANNING FOR BIPED ROBOT BASED ON FUZZY Q-LEARNING APPROACH
SN - 978-989-8111-31-9
AU - Sabourin C.
AU - Madani K.
AU - Yu W.
AU - Yan J.
PY - 2008
SP - 183
EP - 188
DO - 10.5220/0001486701830188