FORMATION CONTROL BETWEEN A HUMAN AND A MOBILE ROBOT BASED ON STEREO VISION

Flávio Garcia Pereira, Marino Frank Cypriano, Raquel Frizera Vassallo

2010

Abstract

This paper presents a reactive nonlinear formation control between a human and a mobile robot based on stereo vision. The human, who is considered the leader of the formation, is positioned behind the robot and moves around the environment while the robot executes movements according to human movements. The robot has a stereo vision system mounted on it and the images acquired by this system are used to detect the human face and estimate its 3D coordinates. These coordinates are used to determine the relative pose between the human and robot, which is sent to the controller in order to allow the robot to achieve and keep a desired formation with the human. Experimental results were performed with a human and a mobile robot, the leader and follower respectively, to show the performance of the control system. In this paper a load was put on a mobile robot in which the nonlinear controller was applied, allowing the transportation of this load from a initial point to a desired position. In order to verify the proposed method some experiments were performed and shown in this paper.

References

  1. Althaus, P., Ishiguro, H., Kanda, T., Miyashita, T., and Christensen, H. (2004). Navigation for human-robot interaction tasks. In ICRA 7804. 2004 IEEE International Conference on Robotics and Automation, 2004. Proceedings., volume 2, pages 1894-1900 Vol.2.
  2. Bicho, E. and Monteiro, S. (2003). Formation control for multiple mobile robots: a non-linear attractor dynamics approach. In Intelligent Robots and Systems, 2003. (IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, volume 2, pages 2016-2022 vol.2.
  3. Chuy, O., Hirata, Y., and Kosuge, K. (2007). Environment feedback for robotic walking support system control. In ICRA, pages 3633-3638.
  4. Das, A., Fierro, R., Kumar, V., Ostrowski, J., Spletzer, J., and Taylor, C. (2002). A vision-based formation control framework. Robotics and Automation, IEEE Transactions on, 18(5):813-825.
  5. Egerstedt, M. and Hu, X. (2001). Formation constrained multi-agent control. In Robotics and Automation, 2001. Proceedings 2001 ICRA. IEEE International Conference on, volume 4, pages 3961-3966 vol.4.
  6. Egerstedt, M., Hu, X., and Stotsky, A. (2001). Control of mobile platforms using a virtual vehicle approach. Automatic Control, IEEE Transactions on, 46(11):1777- 1782.
  7. Jadbabaie, A., Lin, J., and Morse, A. (2002). Coordination of groups of mobile autonomous agents using nearest neighbor rules. In Decision and Control, 2002, Proceedings of the 41st IEEE Conference on, volume 3, pages 2953-2958 vol.3.
  8. Pereira, F. G. (2006). Navegac¸a˜o e desvio de obstáculos usando um roboˆ móvel dotado de sensor de varredura laser. Master's thesis, Universidade Federal do Espírito Santo - UFES.
  9. Vidal, R., Shakernia, O., and Sastry, S. (2003). Formation control of nonholonomic mobile robots with omnidirectional visual servoing and motion segmentation. In Robotics and Automation, 2003. Proceedings. ICRA 7803. IEEE International Conference on, volume 1, pages 584-589 vol.1.
  10. Viola, P. and Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2001. CVPR 2001., 1:I-511-I-518 vol.1.
Download


Paper Citation


in Harvard Style

Garcia Pereira F., Frank Cypriano M. and Frizera Vassallo R. (2010). FORMATION CONTROL BETWEEN A HUMAN AND A MOBILE ROBOT BASED ON STEREO VISION . In Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-8425-01-0, pages 135-140. DOI: 10.5220/0002880601350140


in Bibtex Style

@conference{icinco10,
author={Flávio Garcia Pereira and Marino Frank Cypriano and Raquel Frizera Vassallo},
title={FORMATION CONTROL BETWEEN A HUMAN AND A MOBILE ROBOT BASED ON STEREO VISION},
booktitle={Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2010},
pages={135-140},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002880601350140},
isbn={978-989-8425-01-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - FORMATION CONTROL BETWEEN A HUMAN AND A MOBILE ROBOT BASED ON STEREO VISION
SN - 978-989-8425-01-0
AU - Garcia Pereira F.
AU - Frank Cypriano M.
AU - Frizera Vassallo R.
PY - 2010
SP - 135
EP - 140
DO - 10.5220/0002880601350140