TIME-VARYING MULTIMODAL VOLUME RENDERING WITH 3D TEXTURES

Pascual Abellán, Sergi Grau, Dani Tost

2008

Abstract

In this paper, we propose a rendering method for multimodal and time-varying data based on 3D texture mapping. Our method takes as input two registered voxel models: one with static data and the other with time-varying values. It visualizes the fusion of data through time steps of different sizes, forward and backward. At each frame we use one 3D texture for each modality. We compute and compose a set of view-aligned texture slices. For each texel of a slice, we perform a fetch to each 3D texture and realize fusion and shading using a fragment shader. We codify the two shading transfer functions on auxiliary 1D textures. Moreover, the weight of each modality in fusion is not constant but defined through a 2D fusion transfer function implemented as a 2D texture. We benefit from frame-to-frame coherence to avoid reloading the time-varying data texture at each frame. Instead, we update it at each frame using a 2D texture that run-length encodes the variation of property values through time. The 3D texture updating is done entirely on the GPU, which significantly speeds up rendering. Our method is fast and versatile and it provides a good insight into multimodal data.

References

  1. Abellán, P. and D.Tost (2007). Multimodal rendering with 3D textures. In XVII Congreso Espan˜ol de Informática Gráfica 2007, pages 209-216. Thompson Eds.
  2. Anagnostou, K., Atherton, T., and Waterfall, A. (2000). 4D volume rendering with the Shear-Warp factorization. Symp. Volume Visualization and Graphics'00, pages 129-137.
  3. Binotto, A. P. D., Comba, J., and Freitas, C. D. S. (2003). Real-time volume rendering of time-varying data using a fragment-shader compression approach. 6th IEEE Symposium on Parallel and Large-Data Visualization and Graphics, pages 69-76.
  4. Cai, W. and Sakas, G. (1999). Data intermixing and multivolume rendering. Computer Graphics Forum, 18(3):359-368.
  5. Ellsworth, D., Chiang, L. J., and Shen, H. W. (2000). Accelerating time-varying Hardware volume rendering using TSP trees and color-based error metrics. In IEEE Visualization'00, pages 119-128.
  6. Ferré, M., Puig, A., and Tost, D. (2004). A framework for fusion methods and rendering techniques of multimodal volume data. Computer Animation and Virtual Worlds, 15:63-77.
  7. Ferré, M., Puig, A., and Tost, D. (2006). Decision trees for accelerating unimodal, hybrid and multimodal rendering models. The Visual Computer, 3:158-167.
  8. Gagvani, N. and Silver, D. (1999). Parameter-controlled volume thinning. Graphical models and Image Processing, 61(3):149-164.
  9. Hill, D., Hawkes, D., and Hussain, Z. (1993). Accurate combination of CTand MR data of the head: validation and application in surgical and therapy planning. Computer Medical Imaging and Graphics, 17:357- 363.
  10. Hong, H., Bae, J., Kye, H., and Shin, Y. G. (2005). Efficient multimodalty volume fusion using graphics hardware. ICCS 2005, LNCS 3516, pages 842-845.
  11. Hu, X. and al. (1989). Volumetric rendering of multimodality, multivariable medical imaging data. Proc. Chapel Hill Workshop on Volume Visualization, pages 45-49.
  12. Krüger, J. and Westerman, R. (2003). Acceleration techniques for GPU-based volume rendering. In IEEE Visualization'03, pages 287-292.
  13. Lee, J. S., Kim, B., Chee1, Y., Kwark, C., Lee2, M. C., and Park, K. S. (2000). Fusion of coregistered crossmodality images using a temporally alternating display method. Medical and Biological Engineering and Computing, 38(2):127-132.
  14. Liao, S., Chung, Y., and Lai, J. (2002). A two-level differential volume rendering method for time-varying volume data. The Journal of Winter School in Computer Graphics, 10(1):287-316.
  15. Lum, E. B., Ma, K. L., and Clyne, J. (2002). A Hardwareassisted scalable solution for interactive volume rendering of time-varying data. IEEE Trans. on Visualization and Computer Graphics, 8(3):286-301.
  16. Ma, K., Smith, D., Shih, M., and Shen, H. W. (1998). Efficient encoding and rendering of time-varying volume data. Technical Report ICASE NASA Langsley Research Center, pages 1-7.
  17. Meissner, M., Hoffmann, U., and Straßer, W. (1999). Enabling classification and shading for 3D texture mapping based volume rendering using OpenGL and extensions. IEEE Visualization'99, pages 207-214.
  18. Neophytou, N. and Mueller, K. (2002). Space-time points: 4D splatting on efficient grids. In IEEE Symp. on Volume Visualization and graphics, pages 97-106.
  19. Payne, B. and Toga, A. (1990). Surface mapping brain function on 3D models. IEEE Computer Graphics & Applications, 10(5).
  20. Pietrzyk, U. and al. (1996). Clinical applications of registration and fusion of multimodality brain images from PET, SPECT, CT, and MRI. European Journal of Radiology, pages 174-182.
  21. Rehm, K., Strother, S. C., Anderson, J. R., Schaper, K. A., and Rottenberg, D. A. (1994). Display of merged multimodality brain images using interleaved pixels with independent color scales. Journal of Nuclear Medicine, 35(11):1815-1821.
  22. Reinhard, E., C.Hansen, and S.Parker (2002). Interactive ray-tracing of time varying data. In EG Parallel Graphics and Visualisation'02, pages 77-82.
  23. Schneider, J. and Westermann, R. (2003). Compression domain volume rendering. In IEEE Visualization'03, pages 39-47.
  24. Shen, H. W. and Johnson, C. R. (1994). Differential volume rendering: a fast volume visualization tech for flow animation. In IEEE Visualization'94, pages 180-187.
  25. Stokking, R., Zubal, G., and Viergever, M. (2003). Display of fused images: methods, interpretation and diagnsotic improvements. Seminars in Nuclear Medicine, 33(3):219-227.
  26. Stokking, R., Zuiderveld, K., and Hulshoff, P. (1994). Integrated visualization of SPECT and MR images for frontal lobe damaged regions. SPIE Visualization in biomedical computing, 2359:282-292.
  27. Stokking, R., Zuiderveld, K., Hulshoff, P., van Rijk, and Viergever, M. (1997). Normal fusion for threedimensional integrated visualization of spect and magnetic resonance brain images. The Journal of Nuclear medicine, 38(3):624-629.
  28. Viergever, M. A., Maintz, J. B. A., Stokking, R., Elsen, P. A., and Zuiderveld, K. J. (1992). Integrated presentation of multimodal brain images. Brain Topography, 5:135-145.
  29. Younesy, H., Möller, T., and Carr, H. (2005). Visualization of time-varying volumetric data using differential time-histogram table. In Volume Graphics'05, pages 21-29.
  30. Zuiderveld, K. J., Koning, A. H. J., Stokking, R., Maintz, J. B. A., Appelman, F. J. R., and Viergever, M. A. (1996). Multimodality visualization of medical volume data. Computers and Graphics, 20(6):775-791.
Download


Paper Citation


in Harvard Style

Abellán P., Grau S. and Tost D. (2008). TIME-VARYING MULTIMODAL VOLUME RENDERING WITH 3D TEXTURES . In Proceedings of the Third International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2008) ISBN 978-989-8111-20-3, pages 223-230. DOI: 10.5220/0001093802230230


in Bibtex Style

@conference{grapp08,
author={Pascual Abellán and Sergi Grau and Dani Tost},
title={TIME-VARYING MULTIMODAL VOLUME RENDERING WITH 3D TEXTURES},
booktitle={Proceedings of the Third International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2008)},
year={2008},
pages={223-230},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001093802230230},
isbn={978-989-8111-20-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2008)
TI - TIME-VARYING MULTIMODAL VOLUME RENDERING WITH 3D TEXTURES
SN - 978-989-8111-20-3
AU - Abellán P.
AU - Grau S.
AU - Tost D.
PY - 2008
SP - 223
EP - 230
DO - 10.5220/0001093802230230