USING AUGMENTED REALITY FOR REAL-TIME VISUALIZATION OF TACTILE HEALTH EXAMINATION

Gennadiy Nikishkov, Tomokazu Tsuchimoto

Abstract

An augmented-reality approach to real-time visualization of tactile data with projection on a human organ is presented. A target procedure is breast cancer examination with a tactile sensor. The special tactile sensor is used to measure tissue stiffness values at discrete points of the examined organ. We developed an augmented reality system which integrates the tactile sensor, a head-mounted display with a small video camera, and a notebook computer. Tracking of the human organ and the tactile sensor is based on optical markers. One marker is attached to the patient’s body and is used to track the spatial position of the human organ. Another marker is placed on the tactile sensor. Registering space positions of this marker with respect to the first marker allows determination of the shape of the human organ for subsequent data visualization. Results of stiffness measurements are depicted as semi-transparent three-dimensional objects projected on the patient’s body. Different visualization techniques are employed depending on the amount of data and user preference. Experiments with sensing tactile data and its visualization for a variety of objects, including a silicon breast model and animals organs, have been performed. It was found that the developed augmented-reality system is useful in medical-physics measurements.

References

  1. Azuma, R.T. (1997) A Survey of Augmented Reality. Teleoperators and Virtual Environments, 6: 355-385.
  2. Bajura, M., Fuchs, H. and Ohbuchi, R. (1992) Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. Computer Graphics, 26: 203-210.
  3. Balasingham, I., Samset, E., Hansen, A. and Audral L. (2003) An interactive augmented reality 3D visualization system for destroying liver tumor using cryoablation. International Congress Series, 1256: 690-695.
  4. Birkfellner, W., Figl, M., Huber, K. et al. (2002) A headmounted operating binocular for augmented reality visualization in medicine: design and initial evaluation. IEEE Trans Medical Imaging, 21: 991-997.
  5. Das, M., Sauer, F., Schoeph, U.J. et al. (2006) Augmented reality visualization for CT-guided interventions: system description, feasibility and initial evaluation in an abdominal phantom. Radiology, 240: 230-235.
  6. Girnyk, S., Barannik, A., Barannik, E. et al. (2006). The estimation of elasticity and viscosity of soft tissues in vitro using the data of remote acoustic palpation. Ultrasound in medicine and biology, 32: 211-219.
  7. Kaufman, C.S., Jacobson, L., Bachman, B.A. and Kaufman, L.B. (2006). Digital documentation of the physical examination: moving the clinical breast exam to the electronic medical record. The American Journal of Surgery 192: 444-449.
  8. Kearney, T.J., Airapetian, S. and Sarvazyan, A. (2004). Tactile breast imaging to increase the sensitivity of breast examination. Journal of Clinical Oncology, 2004 ASCO Annual Meeting Proceedings, 22: 1037.
  9. Konishi, K. et al. (2005) Augmented reality navigation system for endoscopic surgery based on threedimensional ultrasound and computed tomography: Application to 20 clinical cases. Int. Congress Series, 1281: 537-542.
  10. Lee, S., Wolberg, G. and Shin, S.Y. (1997) Scattered data interpolation, IEEE Trans. on Visualization and Computer Graphics, 3: 228-244.
  11. Omata, S. and Terunuma, Y. (1992). New tactile sensor like the human hand and its applications. Sensor and Actuators A, 35: 9-15.
  12. Rosenthal, M., State, A., Lee, J. et al. (2002) Augmented reality guidance for needle biopsies: an initial randomized, controlled trial in phantoms. Medical Image Analysis, 6: 313-320.
  13. Sakas, G. (2002) Trends in medical imaging: from 2D to 3D. Computers and Graphics, 26: 577-587.
  14. Srikanchana, R., Wang, Y.J., Freedman, M.T. and Nguyen, C.C. (2002). Tactile imaging of palpable breast cancer. Medical Imaging 2002: Physics of Medical Imaging (L.E. Antonuk, M.J. Yaffe Eds.), Proc. SPIE, 4682: 792-800.
Download


Paper Citation


in Harvard Style

Nikishkov G. and Tsuchimoto T. (2007). USING AUGMENTED REALITY FOR REAL-TIME VISUALIZATION OF TACTILE HEALTH EXAMINATION . In Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 2: GRAPP, ISBN 978-972-8865-72-6, pages 91-97. DOI: 10.5220/0002074800910097


in Bibtex Style

@conference{grapp07,
author={Gennadiy Nikishkov and Tomokazu Tsuchimoto},
title={USING AUGMENTED REALITY FOR REAL-TIME VISUALIZATION OF TACTILE HEALTH EXAMINATION},
booktitle={Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 2: GRAPP,},
year={2007},
pages={91-97},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002074800910097},
isbn={978-972-8865-72-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 2: GRAPP,
TI - USING AUGMENTED REALITY FOR REAL-TIME VISUALIZATION OF TACTILE HEALTH EXAMINATION
SN - 978-972-8865-72-6
AU - Nikishkov G.
AU - Tsuchimoto T.
PY - 2007
SP - 91
EP - 97
DO - 10.5220/0002074800910097