ENHANCING VIRTUAL ENVIRONMENT-BASED SURGICAL TEAMWORK TRAINING WITH NON-VERBAL COMMUNICATION

Stefan Marks, Burkhard Wünsche, John Windsor

2009

Abstract

Virtual reality simulations for training surgical skills are increasingly used in medical education and have been shown to improve patient outcome. While advances in hardware and simulation techniques have resulted in many commercial applications for training technical skills, most of these simulators are extremely expensive and do not consider non-technical skills like teamwork and communication. This is a major drawback since recent research suggests that a large percentage of mistakes in clinical settings are due to communication problems. In addition, training teamwork can also improve the efficiency of a surgical team and as such reduce costs and workload. We present an inexpensive camera-based system for capturing aspects of non-verbal communication of users participating in virtual environment-based teamwork simulations. This data can be used for the enhancement of virtual-environment-based simulations to increase the realism and effectiveness of team communication.

References

  1. Briechle, K. and Hanebeck, U. D. (2001). Template matching using fast normalized cross correlation. Proceedings of the Society of Photo-Optical Instrumentation Engineers (SPIE), 4387(95):95-102.
  2. Chen, L. and Grecos, C. (2005). A fast skin region detector for colour images. IEE Conference Publications, 2005(CP509):195-201.
  3. Ekman, P., Friesen, W. V., and Hager, J. C. (2002). The Facial Action Coding System - Second Edition. Weidenfeld & Nicolson.
  4. Epic Games. Unreal Engine 3 [online]. (2006) [cited 17.08.2007]. Available from: http://www.unrealtechnology.com/html/technology/ ue30.shtml.
  5. Garau, M., Slater, M., Bee, S., and Sasse, M. A. (2001). The impact of eye gaze on communication using humanoid avatars. In CHI 7801: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 309-316, New York, NY, USA. ACM.
  6. Guise, J.-M. and Segel, S. (2008). Teamwork in obstetric critical care. Best Practice & Research Clinical Obstetrics & Gynaecology, 22(5):937-951.
  7. Hammal, Z., Massot, C., Bedoya, G., and Caplier, A. (2005). Eyes Segmentation Applied to Gaze Direction and Vigilance Estimation. In Pattern Recognition and Image Analysis, volume 3687/2005 of Lecture Notes in Computer Science, pages 236-246. Springer Berlin, Heidelberg.
  8. Kohn, L. T., Corrigan, J. M., and Donaldson, M. S., editors (1999). To Err is Human: Building a Safer Health System. National Academy Press, Washington, DC, USA. Available from: http://www.nap.edu/catalog.php?record id=9728 [cited 17.04.2007].
  9. Linden Research, Inc. Second Life [online]. (2008) [cited 08.09.2008]. Available from: http://secondlife.com/.
  10. Lingard, L., Espin, S., Whyte, S., Regehr, G., Baker, G. R., Reznick, R., Bohnen, J., Orser, B., Doran, D., and Grober, E. (2004). Communication failures in the operating room: An observational classification of recurrent types and effects. Quality & Safety in Health Care, 13(5):330-334.
  11. Manninen, T. (2001). Virtual Team Interactions in Networked Multimedia Games - Case: “Counter-Strike” - Multi-player 3D Action Game. In Proceedings of PRESENCE2001 Conference.
  12. Manninen, T. (2004). Rich Interaction Model for Game and Virtual Environment Design. PhD thesis, University of Oulu, Finland.
  13. Marks, S., Windsor, J., and Wünsche, B. (2007). Evaluation of Game Engines for Simulated Surgical Training. In GRAPHITE 7807: Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia, pages 273-280, New York, NY, USA. ACM.
  14. Scott, D. J., Cendan, J. C., Pugh, C. M., Minter, R. M., Dunnington, G. L., and Kozar, R. A. (2008). The Changing Face of Surgical Education: Simulation as the New Paradigm. Journal of Surgical Research, 147(2):189- 193.
  15. Serious Games Initiative. Serious Games Initiative [online]. (2007) [cited 17.08.2007]. Available from: http://www.seriousgames.org.
  16. Slater, M., Howell, J., Steed, A., Pertaub, D.-P., and Gaurau, M. (2000). Acting in Virtual Reality. In Proceedings of the Third International Conference on Collaborative Virtual Environments, pages 103-110.
  17. Taekman, J., Segall, N., Hobbs, E., and Wright, M. (2007). 3DiTeams - Healthcare Team Training in a Virtual Environment. Anesthesiology, 107(A2145):A2145.
  18. Terrillon, J.-C., Fukamachi, H., Akamatsu, S., and Shirazi, M. N. (1999). Comparative Performance of Different Chrominance Spaces for Color Segmentation and Detection of Human Faces in Complex Scene Images. In Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, pages 54-61.
  19. Ullberg, L., Monahan, C., and Harvey, K. (2007). The New Face of emergency preparedness training: using Second Life to save first lives. In Livingstone, D. and Kemp, J., editors, Second Life Education Workshop 2007, pages 96-99. Available from: http://www.simteach.com/slccedu07proceedings.pdf.
  20. Undre, S. and Darzi, A. (2007). Laparoscopy Simulators. Journal of Endourology, 21(3):274-279.
  21. Valve Corporation. Valve Source Engine Features [online]. (2004) [cited 17.08.2007]. Available from: http://www.valvesoftware.com/sourcelicense/engine features.htm.
  22. Vertegaal, R., Slagter, R., van der Veer, G., and Nijholt, A. (2001). Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes. In CHI 7801: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 301-308, New York, NY, USA. ACM.
  23. Vertegaal, R., van der Veer, G., and Vons, H. (2000). Effects of Gaze on Multiparty Mediated Communication. In Graphics Interface, pages 95-102.
  24. Virtual Heroes. Virtual Heroes Inc - Serious Games and Andvanced Learning Systems [online]. (2008) [cited 04.09.2008]. Available from: http://www.virtualheroes.com
  25. Whitehill, J. and Omlin, C. W. (2006). Haar Features for FACS AU Recognition. Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition (FGR06), pages 97-101.
  26. Yule, S., Flin, R., Paterson-Brown, S., and Maran, N. (2006). Non-technical skills for surgeons in the operating room: A review of the literature. Surgery, 139(2):140-149.
Download


Paper Citation


in Harvard Style

Marks S., Wünsche B. and Windsor J. (2009). ENHANCING VIRTUAL ENVIRONMENT-BASED SURGICAL TEAMWORK TRAINING WITH NON-VERBAL COMMUNICATION . In Proceedings of the Fourth International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2009) ISBN 978-989-8111-67-8, pages 361-366. DOI: 10.5220/0001793703610366


in Bibtex Style

@conference{grapp09,
author={Stefan Marks and Burkhard Wünsche and John Windsor},
title={ENHANCING VIRTUAL ENVIRONMENT-BASED SURGICAL TEAMWORK TRAINING WITH NON-VERBAL COMMUNICATION},
booktitle={Proceedings of the Fourth International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2009)},
year={2009},
pages={361-366},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001793703610366},
isbn={978-989-8111-67-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2009)
TI - ENHANCING VIRTUAL ENVIRONMENT-BASED SURGICAL TEAMWORK TRAINING WITH NON-VERBAL COMMUNICATION
SN - 978-989-8111-67-8
AU - Marks S.
AU - Wünsche B.
AU - Windsor J.
PY - 2009
SP - 361
EP - 366
DO - 10.5220/0001793703610366