A REAL TIME GESTURE RECOGNITION SYSTEM FOR MOBILE ROBOTS

Vanderlei Bonato, Adriano K. Sanches, M.M. Fernandes, Jo˜ão M. P. Cardoso, E. D. V. Simoes, Eduardo Marques

2004

Abstract

This paper presents a vision system to be embedded in a mobile robot, both of them implemented using reconfigurable computing technology. The vision system captures gestures by means of a digital color camera, and then performs some pre-processing steps in order to use the image as input to a RAM-based neural network. The set of recognized gestures can be dened using the system on-chip training capabilities. All the above functionality has been implemented in a single FPGA chip. Experimental results have shown the system to be robust, with enough performance to meet real-time constraints (30 fps), and also high efficiency in the recognition process (true recognition rate of 99.57%).

References

  1. Altera (2004). Nios Development Kit, Stratix Edition. http://www.altera.com/products/devkits/altera/kitnios 1S10.html.
  2. Austin, J. (1998). RAM-Based Neural Network. World Scienti c Publishing Co. Pte. Ltd., London.
  3. Cardoso, J. M. P. and Neto, H. C. (2003). Compilation for fpga-based recon gurable hardware. IEEE Design & Test of Computers Magazine, 20(2):65-75.
  4. ChiZhang, P. W. (2000). A new method of color image segmentation based on intensity and hue clustering. In IEEE International Conference on Pattern Recognition - ICPR, volume 3, page 3617.
  5. Costa, L. d. F. and Cesar Jr., R. M. (2000). Shape Analysis and Classi cation. Phillip A. Laplante, New York.
  6. Cummings, R. E., Pouliquen, P., and M. Lewis, A. (2003). A vision chip for color segmentation and pattern matching. EURASIP JASP, pages 703-712.
  7. Electronics, Q. (2004). http://www.quasarelectronics.com/c3188a.htm.
  8. Gonc¸alves, R., Wolf, D. F., Rodrigues, M. I., Osorio, L. F., Moraes, P. A., Genuário, L. B., Teixeira, M. A., Ribeiro, A. A. L., Romero, R. A. F., and Marques, E. (2001). Architect-r: A system for recon gurable robots design - an overview and initial results. In VLSI-SOC'01, volume I, pages 60-64.
  9. Gonc¸alves, R. A., Moraes, P. A., Cardoso, J. M. P., Wolf, D. F., F. M. M., Romero, R. A. F., and Marques, E. (2003). Architect-r: a system for recon gurable robots design. In Proceedings of the 2003 ACM symposium on Applied computing. ACM Press New York, NY, USA.
  10. Gonzalez, R. C. and Woods, R. E. (1992). Digital Image Processing. Addison-Wesley Company, New York.
  11. Old eld, J. V. (1995). Field-programmable gate arrays: recon gurable logic for rapid prototyping and implementation of digital systems. John Wiley & Sons, Inc.
  12. Philips (2003). The i2c-bus speci cation. http://www.semiconductors.philips.com/acrobat/literature9398/39340011.pdf.
  13. Rowe, A. (2002). A low cost embedded color vision system. IEEE Intelligent Robots and Systems - IROS.
  14. Russ, J. C. (1995). The Image Processing Handbook. CRC Press, Boca Raton, 2a edition.
  15. Swenson, R. L. (2002). A real-time high performance universal colour transformation hardware system. PhD thesis, University of Kent at Canterbury, Canterbury - Kent.
  16. Thrun, S., Schulte, J., and Rosenberg, C. (2000). Interaction with mobile robots in public places. IEEE Intelligent Systems, pages 7-11.
  17. Turk, M. (2004). Computer vision in the interface. volume 47, pages 60-64. ACM Press New York, NY, USA.
  18. Waldherr, S., Romero, R., and Thrun, S. (2000). A gesture based interface for human-robot interaction. Autonomous Robots, 9(7):151-173.
  19. Zemcik, P. (2002). Hardware acceleration of graphics and imaging algorithms using fpgas. In Proceedings of the 18th spring conference on Computer graphics, pages 25-32. ACM Press New York, NY, USA.
Download


Paper Citation


in Harvard Style

Bonato V., Sanches A., Fernandes M., Cardoso J., Simoes E. and Marques E. (2004). A REAL TIME GESTURE RECOGNITION SYSTEM FOR MOBILE ROBOTS . In Proceedings of the First International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 972-8865-12-0, pages 207-214. DOI: 10.5220/0001140202070214


in Bibtex Style

@conference{icinco04,
author={Vanderlei Bonato and Adriano K. Sanches and M.M. Fernandes and Jo˜ão M. P. Cardoso and E. D. V. Simoes and Eduardo Marques},
title={A REAL TIME GESTURE RECOGNITION SYSTEM FOR MOBILE ROBOTS},
booktitle={Proceedings of the First International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2004},
pages={207-214},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001140202070214},
isbn={972-8865-12-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - A REAL TIME GESTURE RECOGNITION SYSTEM FOR MOBILE ROBOTS
SN - 972-8865-12-0
AU - Bonato V.
AU - Sanches A.
AU - Fernandes M.
AU - Cardoso J.
AU - Simoes E.
AU - Marques E.
PY - 2004
SP - 207
EP - 214
DO - 10.5220/0001140202070214