A Natural Interaction Paradigm to Facilitate Cardiac Anatomy Education using Augmented Reality and a Surgical Metaphor

Dmitry Resnyansky, Nurullah Okumus, Mark Billinghurst, Emin Ibili, Tolga Ertekin, Düriye Öztürk, Taha Erdogan

2022

Abstract

This paper presents a design approach to creating a learning experience for cardiac anatomy by providing an interactive visualisation environment that uses Head Mounted Display (HMD)-based Augmented Reality (AR). Computed tomography imaging techniques were used to obtain accurate model geometry that was optimised in a 3D modelling software package, followed by photo-realistic texture mapping using 3D painting software. This method simplifies the process of modelling complex, organic geometry. Animation, rendering techniques, and AR capability were added using the Unity game engine. The system’s design and development maximises immersion, supports natural gesture interaction within a real-world learning setting, and represents complex learning content. Hand input was used with a surgical-dissection metaphor to show cross-section rendering in AR in an intuitive manner. Lessons learned from the modelling process are discussed as well as directions for future research.

Paper Citation

in Harvard Style

Resnyansky D., Okumus N., Billinghurst M., Ibili E., Ertekin T., Öztürk D. and Erdogan T. (2022). A Natural Interaction Paradigm to Facilitate Cardiac Anatomy Education using Augmented Reality and a Surgical Metaphor. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 1: GRAPP; ISBN 978-989-758-555-5, SciTePress, pages 204-211. DOI: 10.5220/0010835400003124

in Bibtex Style

@conference{grapp22,
author={Dmitry Resnyansky and Nurullah Okumus and Mark Billinghurst and Emin Ibili and Tolga Ertekin and Düriye Öztürk and Taha Erdogan},
title={A Natural Interaction Paradigm to Facilitate Cardiac Anatomy Education using Augmented Reality and a Surgical Metaphor},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 1: GRAPP},
year={2022},
pages={204-211},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010835400003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 1: GRAPP
TI - A Natural Interaction Paradigm to Facilitate Cardiac Anatomy Education using Augmented Reality and a Surgical Metaphor
SN - 978-989-758-555-5
AU - Resnyansky D.
AU - Okumus N.
AU - Billinghurst M.
AU - Ibili E.
AU - Ertekin T.
AU - Öztürk D.
AU - Erdogan T.
PY - 2022
SP - 204
EP - 211
DO - 10.5220/0010835400003124
PB - SciTePress