Knowledge Engineering and Ontologies for Object Manipulation in Collaborative Virtual Reality

Manolya Kavakli

2012

Abstract

This project describes an ontology for a collaborative engineering task. The task is to take apart an interactive 3D model in 3D space using virtual reality and to manipulate an object. The project examines a virtual environment in which two engineers can perform a number of tasks for manipulating object parts controlling a wiimote inside an immersive projection system. The interface recognizes hand-gestures of the engineers, pass commands to a VR modelling package via a gesture recognition system, perform the actions on the 3D model of the object, generating it on the immersive projection screen. We use retrospective protocol analysis for knowledge engineering and ontology building analysing the cognitive processes.

References

  1. Bowman, D. and Billinghurst, M. 2002. Special Issue on 3D Interaction in Virtual and Mixed Realities: Guest Editors' Introduction. Virtual Reality, vol. 6, no.3, pp. 105-106.
  2. Coquillart, S., 1990. Extended Free-Form Deformation: A sculpturing tool for 3D geometric modeling. In SIGGRAPH 7890, vol 24, number 4, pages 187-196, ACM, August.
  3. Jagnow, R., Dorsey, J., 2006: Virtual Sculpting with Haptic Displacement Maps. robjagnow.com/research/ HapticSculpting.pdf, last accessed: 10th Jun 2006.
  4. Kavakli, M., Scrivener, S.A.R, Ball, L.J., 1998. The Structure of Sketching Behaviour, Design Studies, 19, 485-517.
  5. Kavakli, M., Suwa, M., Gero, J. S., Purcell, T., 1999. Sketching interpretation in novice and expert designers, in Gero, J.S., and Tversky, B. (eds), Visual and Spatial Reasoning in Design, University of Sydney, Sydney, 209-219.
  6. Kavakli, M., Gero, J. S., 2001a. Sketching as mental imagery processing, Design Studies, Vol 22/4, 347- 364.
  7. Kavakli, M., Gero, J. S., 2001b. Strategic Knowledge Differences between an Expert and a Novice, Preprints of the 3rd Int. Workshop on Strategic Knowledge and Concept Formation, University of Sydney, 44-68.
  8. Kavakli, M., Gero, J. S., 2002. Structure of Concurrent Cognitive actions: A Case Study on Novice & Expert Designers, Design Studies, Vol 23/1, 25-40.
  9. Kavakli, M., Gero, J. S., 2003. Difference between expert and novice designers: an experimental study, in U Lindemann et al (eds), Human Behaviour in Design, Springer, pp 42-51.
  10. Kjeldsen, F. C. M.,1997. Visual Interpretation of Hand Gestures as a Practical Interface Modality, PhD Thesis, Grad. Sch. of Arts and Sci., Columbia Uni.
  11. Lau,R., Li, F., and Ng, F., 2003. "VSculpt: A Distributed Virtual Sculpting Environment for Collaborative Design," IEEE Trans. on Multimedia, 5(4):570-580
  12. McNeill, D., 2006. Gesture and Thought, The Summer Institute on Verbal and Non-verbal Communication and the Biometrical Principle, Sept. 2-12, 2006, Vietri sul Mare (Italy), organized by Anna Esposito, http://mcneilllab.uchicago.edu/pdfs/dmcn_vietri_sul_ mare.pdf (last accessed on 19.8.2012).
  13. Mizuno, S., Okada, M., Toriwaki, J., 1999. Virtual sculpting and virtual woodblock printing as a tool for enjoying creation of 3d shapes. FORMA, volume 15, number 3, pages 184-193, 409, September.
  14. Mulder, A., 1996. Hand Gestures for HCI, Hand Centered Studies of Human Movement Project, Technical Report 96-1, School of Kinesiology, Simon Fraser University, February.
  15. Noy, N. F. and McGuinness, D. L. 2001. Ontology Development 101: A Guide to Creating Your First Ontology. Stanford Knowledge Systems Laboratory Technical Report KSL-01-05 and Stanford Medical Informatics Technical Report SMI-2001-0880, March.
  16. Parry, S. R., 1986. Free-form deformations in a constructive solid geometry modeling system. PhD thesis. Brigham Young University.
  17. Parent, R. E., 1977, A system for sculpting 3-D data. In SIGGRAPH'77, volume 11, pages 138-147. ACM, July.
  18. Pederson, T., 2000. Human Hands as a link between physical and virtual, Conf. on Designing Augmented Reality Systems (DARE2000), Helsinore, Denmark, 12-14 April.
  19. Salomon, D., 2005. Curves and Surfaces for Computer Graphics. Springer Verlag August 2005. ISBN 0-387- 24196-5. LCCN T385.S2434 2005. xvi+461 pages.
  20. Scrivener, S. A. R., Harris, D., Clark, S. M., Rockoff, T., Smyth, M., 1993. Designing at a Distance via Realtime Designer-to-Designer Interaction, Design Studies, 14(3), 261-282.
  21. Suwa, M., Gero, J. S., and Purcell, T.: 1998. Macroscopic analysis of design processes based on a scheme for coding designers' cognitive actions, Design Studies 19(4), 455-483.
  22. Ugwu, O. O., Anumba, C. J., Thorpe, A., 2001. Ontology development for agent-based collaborative design, Engineering, Construction and Architectural Management, Vol. 8 Iss: 3, pp.211 - 224.
Download


Paper Citation


in Harvard Style

Kavakli M. (2012). Knowledge Engineering and Ontologies for Object Manipulation in Collaborative Virtual Reality . In Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2012) ISBN 978-989-8565-30-3, pages 284-289. DOI: 10.5220/0004170202840289


in Bibtex Style

@conference{keod12,
author={Manolya Kavakli},
title={Knowledge Engineering and Ontologies for Object Manipulation in Collaborative Virtual Reality},
booktitle={Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2012)},
year={2012},
pages={284-289},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004170202840289},
isbn={978-989-8565-30-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2012)
TI - Knowledge Engineering and Ontologies for Object Manipulation in Collaborative Virtual Reality
SN - 978-989-8565-30-3
AU - Kavakli M.
PY - 2012
SP - 284
EP - 289
DO - 10.5220/0004170202840289