DESIGNING A MIXED REALITY FRAMEWORK FOR ENRICHING INTERACTIONS IN ROBOT SIMULATION

Ian Yen-Hung Chen, Bruce A. MacDonald, Burkhard C. Wünsche

Abstract

Experimentation of expensive robot systems typically requires complex simulation models and expensive hardware setups for constructing close-to-real world environments in order to obtain reliable results and draw insights to the actual operation. However, the test-development cycle is often time-consuming and resource demanding. A cost-effective solution is to conduct experiments by replacing expensive or dangerous components with simulated counterparts. Based on the concept of Mixed Reality (MR), robot simulation systems can be created to involve real and virtual entities in the simulation loop. However, seamless interaction between objects from the real and the virtual world remains a challenge. This paper presents a generic framework for constructing MR environments that facilitate interactions between objects from different dimensions of reality. In comparison to previous frameworks, we propose a new interaction scheme that describes the necessary stages for creating interactions between real and virtual objects. We demonstrate the strength of our MR framework and the proposed MR interaction scheme in the context of robot simulation.

References

  1. Arkin, R. (1998). Behavior-based robotics. MIT press.
  2. Barakonyi, I. and Schmalstieg, D. (2006). Ubiquitous animated agents for augmented reality. In IEEE/ACM International Symposium on Mixed and Augmented Reality, 2006. ISMAR 2006., pages 145-154.
  3. Chen, I., MacDonald, B., Wünsche, B., Biggs, G., and Kotoku, T. (2009a). A simulation environment for OpenRTM-aist. In Proceedings of the IEEE International Symposium on System Integration.
  4. Chen, I. Y.-H., MacDonald, B., and Wünsche, B. (2008). Markerless augmented reality for robots in unprepared environments. In Australasian Conference on Robotics and Automation. ACRA08.
  5. Chen, I. Y.-H., MacDonald, B., and Wünsche, B. (2009b). Mixed reality simulation for mobile robots. In Proceedings of the IEEE International Conference on Robotics and Automation, 2009. ICRA'09., pages 232-237, Kobe, Japan.
  6. Collett, T. and MacDonald, B. (2006). Augmented reality visualisation for player. In Proceedings of the 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006., pages 3954-3959.
  7. Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K., and Tachibana, K. (2000). Virtual object manipulation on a table-top ar environment. In Proceedings. IEEE and ACM International Symposium on Augmented Reality, 2000. (ISAR 2000), pages 111-119.
  8. Milgram, P. and Colquhoun, H. (1999). A taxonomy of real and virtual world display integration. Mixed RealityMerging Real and Virtual Worlds.
  9. Nguyen, T. H. D., Qui, T. C. T., Xu, K., Cheok, A. D., Teo, S. L., Zhou, Z., Mallawaarachchi, A., Lee, S. P., Liu, W., Teo, H. S., Thang, L. N., Li, Y., and Kato, H. (2005). Real-time 3d human capture system for mixed-reality art and entertainment. IEEE Transactions on Visualization and Computer Graphics, 11(6):706-721.
  10. Nielsen, C., Goodrich, M., and Ricks, R. (2007). Ecological interfaces for improving mobile robot teleoperation. IEEE Transactions on Robotics, 23(5):927-941.
  11. Nishiwaki, K., Kobayashi, K., Uchiyama, S., Yamamoto, H., and Kagami, S. (2008). Mixed reality environment for autonomous robot development. In 2008 IEEE International Conference on Robotics and Automation, Pasadena, CA, USA.
  12. OGRE (2009). OGRE 3D : Object-oriented graphics rendering engine. http://www.ogre3d.org.
  13. O'Hare, G., Duffy, B., Bradley, J., and Martin, A. (2003). Agent chameleons: Moving minds from robots to digital information spaces. pages 18-21.
  14. Pentenrieder, K., Bade, C., Doil, F., and Meier, P. (2007). Augmented reality-based factory planning - an application tailored to industrial needs. In 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, 2007. ISMAR 2007., pages 31-42.
  15. Player/Stage (2008). The player/stage project. http://playerstage.sf.net/.
  16. Rogers, Y., Scaife, M., Gabrielli, S., Smith, H., and Harris, E. (2002). A Conceptual Framework for Mixed Reality Environments: Designing Novel Learning Activities for Young Children. Presence: Teleoperators & Virtual Environments, 11(6):677-686.
  17. Smith, R. (2008). Open dynamics engine. http://www.ode.org/.
Download


Paper Citation


in Harvard Style

Yen-Hung Chen I., A. MacDonald B. and C. Wünsche B. (2010). DESIGNING A MIXED REALITY FRAMEWORK FOR ENRICHING INTERACTIONS IN ROBOT SIMULATION . In Proceedings of the International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2010) ISBN 978-989-674-026-9, pages 331-338. DOI: 10.5220/0002817903310338


in Bibtex Style

@conference{grapp10,
author={Ian Yen-Hung Chen and Bruce A. MacDonald and Burkhard C. Wünsche},
title={DESIGNING A MIXED REALITY FRAMEWORK FOR ENRICHING INTERACTIONS IN ROBOT SIMULATION},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2010)},
year={2010},
pages={331-338},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002817903310338},
isbn={978-989-674-026-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2010)
TI - DESIGNING A MIXED REALITY FRAMEWORK FOR ENRICHING INTERACTIONS IN ROBOT SIMULATION
SN - 978-989-674-026-9
AU - Yen-Hung Chen I.
AU - A. MacDonald B.
AU - C. Wünsche B.
PY - 2010
SP - 331
EP - 338
DO - 10.5220/0002817903310338