An Application to Interact with 3D Models Reconstructed from Medical Images

Félix Paulano, Juan J. Jiménez, Rubén Pulido

2014

Abstract

Although the reconstruction of 3D models from medical images is not an easy task, there are many algorithms to perform it. However, the reconstructed models are usually large, have a lot of outliers and have not a correct topology. To interact with these models, the methods must be fast and robust. In this paper, we present an application that enables the interaction with models reconstructed from medical images. The application uses Marching Cubes to generate triangle soups from the medical scans. Then, the user can define models by selecting sets of triangles. Once the models have been defined, the application allows to interact with them. In addition, a detailed collision detection is calculated between the models in the scene not only to avoid that models in the scene collide, but also to determine which triangles are overlapping. In addition, the calculation of distances and nearest points provides visual aid when the user is interacting with the models. Finally, the Leonar3Do system have been incorporated to improve the interaction and to provide stereo visualization. The presented application can be used in the field of education since users can manipulate individual body parts to examine them. Moreover, the application can be utilized in the preparation of an intervention or even as a guide for it, since it enables the utilization of models reconstructed from real medical scans.

References

  1. Bhanirantka, P. and Demange, Y. (2002). OpenGL volumizer: a toolkit for high quality volume rendering of large data sets. In Symposium on Volume Visualization and Graphics, 2002. Proceedings. IEEE / ACM SIGGRAPH, pages 45-53. IEEE.
  2. Blanchette, J. and Summerfield, M. (2006). C++ GUI Programming with Qt 4. Prentice Hall Open Source Software Development Series. Prentice Hall PTR.
  3. Boubekeur, T., Heidrich, W., Granier, X., and Schlick, C. (2006). Volume-Surface Trees. Computer Graphics Forum, 25(3):399-406.
  4. der Bergen, G. V. (2003). Collision Detection in Interactive 3D Environments. Elsevier.
  5. Jiménez, J. J., Ogáyar, C. J., Segura, R. J., and Feito, F. R. (2006). Collision Detection between a Complex Solid and a Particle Cloud assisted by Programmable GPU. In Vriphys: 3rd Workshop in Virtual Realitiy, Interactions, and Physical Simulation, pages 43-52.
  6. Larsen, E., Gottschalk, S., Lin, M., and Manocha, D. (1999). Fast proximity queries with swept sphere volumes. Technical report, Department of Computer Science, UNC Chapel Hill.
  7. Leonar3Do (2012). Leonar3do. http://www.leonar3do.com. [Online; accessed 2-October-2013].
  8. Lv, S., Yang, X., Gu, L., Xing, X., and Pan, L. (2009). Delaunay mesh reconstruction from 3D medical images based on centroidal voronoi tessellations. In Computational Intelligence and Software Engineering, 2009. CiSE 2009. International Conference on, pages 1-4.
  9. NLM (1986). The visible human project. http://www.nlm. nih.gov/research/visible/visible human.html.
  10. Paulano, F., Jiménez, J. J., Pulido, R., and Ogayar, C. J. (2012). A comparative study of implemented collision detection strategies. In Proceedings of the International Conference on Computer Graphics Theory and Applications (GRAPP 2012), pages 485-490.
  11. Pulido, R., Jiménez, J. J., and Paulano, F. (2012). Surface reconstruction from 3d medical images based on tritree contouring. In Proceedings of the International Conference on Computer Graphics Theory and Applications (GRAPP 2012), pages 175-181.
  12. Rautek, P., Bruckner, S., and Gröller, E. (2007). Semantic layers for illustrative volume rendering. IEEE transactions on visualization and computer graphics, 13(6):1336-1343.
  13. Sachse, F. (2004). 5. digital image processing. In Computational Cardiology, volume 2966 of Lecture Notes in Computer Science, pages 91-118. Springer Berlin.
  14. Schroeder, W., Martin, K. M., and Lorensen, W. E. (2006). The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics. Kitware, Inc.
  15. Sharf, A., Lewiner, T., Shklarski, G., Toledo, S., and CohenOr, D. (2007). Interactive topology-aware surface reconstruction. ACM Trans. on Graphics, 26(3):43.
  16. Shreiner, D. (2010). OpenGL Programming Guide: The Official Guide to Learning OpenGL, Versions 3.0 and 3.1. OpenGL Series. Addison-Wesley.
  17. Wolf, I., Vetter, M., Wegner, I., Nolden, M., Bottger, T., Hastenteufel, M., Schobinger, M., Kunert, T., and Meinzer, H.-P. (2004). The Medical Imaging Interaction Toolkit (MITK) a toolkit facilitating the creation of interactive software by extending VTK and ITK. In Medical Imaging 2004, pages 16-27. International Society for Optics and Photonics.
  18. Yushkevich, P. A., Piven, J., Hazlett, H. C., Smith, R. G., Ho, S., Gee, J. C., and Gerig, G. (2006). User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability. NeuroImage, 31(3):1116-1128.
Download


Paper Citation


in Harvard Style

Paulano F., Jiménez J. and Pulido R. (2014). An Application to Interact with 3D Models Reconstructed from Medical Images . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-009-3, pages 224-229. DOI: 10.5220/0004834902240229


in Bibtex Style

@conference{visapp14,
author={Félix Paulano and Juan J. Jiménez and Rubén Pulido},
title={An Application to Interact with 3D Models Reconstructed from Medical Images},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={224-229},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004834902240229},
isbn={978-989-758-009-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)
TI - An Application to Interact with 3D Models Reconstructed from Medical Images
SN - 978-989-758-009-3
AU - Paulano F.
AU - Jiménez J.
AU - Pulido R.
PY - 2014
SP - 224
EP - 229
DO - 10.5220/0004834902240229