AN OCCLUSION-AWARE AR AUTHORING TOOL FOR ASSEMBLY AND REPAIR TASKS

Jesús Gimeno, Pedro Morillo, Juan Manuel Orduña, Marcos Fernández

Abstract

The use of authoring tools has become a valuable trend for the fast development of Augmented Reality (AR) applications in industrial organizations. However, most of current AR authoring tools are actually programming interfaces that are exclusively suitable for programmers. Moreover, they do not provide advanced visual effects, such as occlusion or object collision detection, to the resulting AR applications. In this paper, we propose an easy-to-use AR authoring tool oriented to the development of AR applications for the execution of industrial sequential procedures. Unlike other recent easy-to-use AR authoring tools, this software framework allows non-programming users to develop low-cost AR applications, including occlusion capabilities, by means of the use of a Kinect sensor. These applications could be used in on-site assembly and maintenance/repair tasks where a certain level of depth perception is needed. In order to validate our AR authoring tool, we have developed four AR applications belonging to different industrial areas. The evaluation results show that overlaying 3D instructions on the actual work pieces reduces the error rate for an assembly task by more than a 75%, particularly diminishing cumulative errors common in sequential procedures. Also, the results show that the time required by non-programming users to develop the AR prototypes using our tool was more than 90% lower than the time required for developing the same prototypes with computer graphics programmers. These results show the potential of our approach and validate the tool as a general-purpose AR authoring tool for industrial AR applications.

References

  1. Abawi, D. F., Luis, J., Arcos, L., Haller, M., Hartmann, W., Huhtala, K., and Trskbck, M. (2004). A mixed reality museum guide: The challenges and its realization. In Proceedings of the 10th International Conference on Virtual Systems and Multimedia (VSMM 2004).
  2. Azuma, R. (1997). A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):355-385.
  3. Baird, K. and Barfield, W. (1999). Evaluating the effectiveness of augmented reality displays for a manual assembly task. Virtual Reality, 4:250-259.
  4. Blanchette, J. and Summerfield, M. (2008). C++ GUI Programming with Qt 4. Open Source Software Development Series. Prentice Hall.
  5. Breen, D. E., Whitaker, R. T., Rose, E., and Tuceryan, M. (1996). Interactive occlusion and automatic object placement for augmented reality. Computer Graphics Forum, 15(3):11-22.
  6. Burns, D. and Osfield, R. (2004). Open scene graph a: Introduction, b: Examples and applications. In Proceedings of the IEEE Virtual Reality Conference 2004 (VR 2004), page 265.
  7. Campbell, D. J. (1988). Task complexity: A review and analysis. Academy of Management Review, 13(1):40.
  8. Cawood, S. and Fiala, M. (2008). Augmented Reality: A Practical Guide. Pragmatic Bookshelf.
  9. Friedrich, W. (2002). Arvika-augmented reality for development, production and service. In In Proceedings of the IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR02),, pages 3-4.
  10. Hampshire, A., Seichter, H., Grasset, R., and Billinghurst, M. (2006). Augmented reality authoring: generic context from programmer to designer. In In Proceedings of the Australasian Computer-Human Interaction Conference (OZCHI'06), pages 409-412.
  11. Haringer, M. and Regenbrecht, H. T. (2002). A pragmatic approach to augmented reality authoring. In Proceedings of the 1st International Symposium on Mixed and Augmented Reality, ISMAR 7802, pages 237-, Washington, DC, USA. IEEE Computer Society.
  12. Henderson, S. J. and Feiner, S. (2009). Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality, pages 135- 144. IEEE Computer Society.
  13. Kato, H. and Billinghurst, M. (1999). Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In Proceedings of International Workshop on Augmented Reality (IWAR'99), pages 85-94.
  14. Ledermann, F. and Schmalstieg, D. (2005). April: A highlevel framework for creating augmented reality presentations. In In Proceedings of the IEEE Virtual Reality Conference 2005 (VR 2005), pages 187-194.
  15. MacIntyre, B., Gandy, M., Dow, S., and Bolter, J. (2005). Dart: a toolkit for rapid design exploration of augmented reality experiences. ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH 2005, 24(3).
  16. Neumann, U. and Majoros, A. (1998). Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. In In Proceedings of the IEEE Virtual Reality Annual International Symposium (VR 7898), pages 4-11.
  17. Nilsson, S., Johansson, B., and Jnsson, A. (2010). The Engineering of Mixed Reality Systems, chapter A Holistic Approach to Design and Evaluation of Mixed Reality Systems, pages 33-55. Human-Computer Interaction Series. Springer.
  18. Ong, S. K., Yuan, M. L., and Nee, A. Y. C. (2008). Augmented reality applications in manufacturing: a survey. International Journal of Production Research, 46(10):2707-2742.
  19. Poupyrev, I., Tan, D., Billinghurst, M., Kato, H., Regenbrecht, H., and Tetsutani, N. (2001). Tiles: A mixed reality authoring interface. In Proceedings of Conference on Human-Computer Interaction (INTERACT 7801), pages 334-341.
  20. Sang-Cheol, P., Sung-Hoon, L., Bong-Kee, S., and SeongWhan, L. (2005). Tracking non-rigid objects using probabilistic hausdorff distance matching. Pattern Recognition, 38(12):2373-2384.
  21. Santos, E. S., Lamounier, E. A., and Cardoso, A. (2011). Interaction in augmented reality environments using kinect. In Proceedings of the 2011 XIII Symposium on Virtual Reality, SVR 7811, pages 112-121, Washington, DC, USA. IEEE Computer Society.
  22. Schmalstieg, D. (2005). Rapid prototyping of augmented reality applications with the studierstube framework. In In Proceedings of the Workshop of Industrial Augmented Reality (IAR), IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR05).
  23. Schwald, B., Laval, B. D., Sa, T. O., and Guynemer, R. (2003). An augmented reality system for training and assistance to maintenance in the industrial context. In In Proceedings of 11th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, pages 425-432.
  24. Seichter, H., Looser, J., and Billinghurst, M. (2008). Composar: An intuitive tool for authoring ar applications. In In Proceedings of the IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR08), pages 177-178.
  25. Seo, J. and OhM, S. (2007). Pvot: An interactive authoring tool for virtual reality. International Journal of Computer Science and Network Security (IJCSNS), 7(4):17-26.
  26. Traskback, M., Koskinen, T., and Nieminenl, M. (2003). User-centred evaluation criteria for a mixed reality authoring application. In Proc. of Tenth International Conference on Human-Computer Interaction (HCI), pages 1263-1267.
  27. Wagner, D. and Schmalstieg, D. (2007). Artoolkitplus for pose tracking on mobile devices. In Proceedings of 12th Computer Vision Winter Workshop (CVWW'07), pages 139-146.
  28. Wang, M., Tseng, C., and Shen, C. (2010). An easy to use augmented reality authoring tool for use in examination purpose. Human-Computer Interaction, 332:285-288.
Download


Paper Citation


in Harvard Style

Gimeno J., Morillo P., Manuel Orduña J. and Fernández M. (2012). AN OCCLUSION-AWARE AR AUTHORING TOOL FOR ASSEMBLY AND REPAIR TASKS . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012) ISBN 978-989-8565-02-0, pages 377-386. DOI: 10.5220/0003843303770386


in Bibtex Style

@conference{grapp12,
author={Jesús Gimeno and Pedro Morillo and Juan Manuel Orduña and Marcos Fernández},
title={AN OCCLUSION-AWARE AR AUTHORING TOOL FOR ASSEMBLY AND REPAIR TASKS},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)},
year={2012},
pages={377-386},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003843303770386},
isbn={978-989-8565-02-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)
TI - AN OCCLUSION-AWARE AR AUTHORING TOOL FOR ASSEMBLY AND REPAIR TASKS
SN - 978-989-8565-02-0
AU - Gimeno J.
AU - Morillo P.
AU - Manuel Orduña J.
AU - Fernández M.
PY - 2012
SP - 377
EP - 386
DO - 10.5220/0003843303770386