WAVE: A 3D Online Previewing Framework for Big Data Archives

Nicholas Tan Jerome, Suren Chilingaryan, Andrei Shkarin, Andreas Kopmann, Michael Zapf, Alexander Lizin, Till Bergmann


With data sets growing beyond terabytes or even petabytes in scientific experiments, there is a trend of keeping data at storage facilities and providing remote cloud-based services for analysis. However, accessing these data sets remotely is cumbersome due to additional network latency and incomplete metadata description. To ease data browsing on remote data archives, our WAVE framework applies an intelligent cache management to provide scientists with a visual feedback on the large data set interactively. In this paper, we present methods to reduce the data set size while preserving visual quality. Our framework supports volume rendering and surface rendering for data inspection and analysis. Furthermore, we enable a zoom-on-demand approach, where a selected volumetric region is reloaded with higher details. Finally, we evaluated theWAVE framework using a data set from the entomology science research.


  1. Ahrens, J., Jourdain, S., O'Leary, P., Patchett, J., Rogers, D. H., and Petersen, M. (2014). An image-based approach to extreme scale in situ visualization and analysis. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, pages 424-434. IEEE Press.
  2. Astor (2014). Astor web portal. portal.anka.kit.edu/.
  3. Behr, J., Eschler, P., Jung, Y., and Zöllner, M. (2009). X3dom: a dom-based html5/x3d integration model. In Proceedings of the 14th International Conference on 3D Web Technology, pages 127-135. ACM.
  4. Blinn, J. F. (1977). Models of light reflection for computer synthesized pictures. In ACM SIGGRAPH Computer Graphics, volume 11, pages 192-198. ACM.
  5. Burigat, S. and Chittaro, L. (2013). On the effectiveness of overview+ detail visualization on mobile devices. Personal and ubiquitous computing, 17(2):371-385.
  6. Cabello, R. (2011). Threejs. https://threejs.org/.
  7. Childs, H. (2007). Architectural challenges and solutions for petascale postprocessing. In Journal of Physics: Conference Series, volume 78, page 012012. IOP Publishing.
  8. Claypool, M., Claypool, K., and Damaa, F. (2006). The effects of frame rate and resolution on users playing first person shooter games. In Electronic Imaging 2006, pages 607101-607101. International Society for Optics and Photonics.
  9. Congote, J., Segura, A., Kabongo, L., Moreno, A., Posada, J., and Ruiz, O. (2011). Interactive visualization of volumetric data with webgl in real-time. In Proceedings of the 16th International Conference on 3D Web Technology, pages 137-146. ACM.
  10. Coudray, N., Buessler, J.-L., and Urban, J.-P. (2010). A robust thresholding algorithm for unimodal image histograms. Pattern Recognition Letters, (31):1010- 1019.
  11. Esnard, A., Richart, N., and Coulaud, O. (2006). A steering environment for online parallel visualization of legacy parallel simulations. In 2006 Tenth IEEE International Symposium on Distributed Simulation and Real-Time Applications, pages 7-14. IEEE.
  12. Garcia, F. H., Wiesel, E., and Fischer, G. (2013). The ants of kenya (hymenoptera: Formicidae)-faunal overview, first species checklist, bibliography, accounts for all genera, and discussion on taxonomy and zoogeography. Journal of East African Natural History, 101(2):127-222.
  13. Isenberg, P., Elmqvist, N., Scholtz, J., Cernea, D., Ma, K.- L., and Hagen, H. (2011). Collaborative visualization: Definition, challenges, and research agenda. Information Visualization, 10(4):310-326.
  14. Isenberg, P., Isenberg, T., Sedlmair, M., Chen, J., and Möller, T. (2017). Visualization as seen through its research paper keywords. IEEE Transactions on Visualization and Computer Graphics, 23(1).
  15. Johnson, C., Parker, S. G., Hansen, C., Kindlmann, G. L., and Livnat, Y. (1999). Interactive simulation and visualization. Computer, 32(12):59-65.
  16. Khronos (2011). WebGL - OpenGL ES 2.0 for the Web, https://www.khronos.org/webgl/.
  17. Kimball, J., Duchaineau, M., and Kuester, F. (2013). Interactive visualization of large scale atomistic and cosmological particle simulations. In Aerospace Conference, 2013 IEEE, pages 1-9. IEEE.
  18. Kishonti (2011). Gfxbench 4.0. https://gfxbench.com/.
  19. Kruger, J. and Westermann, R. (2003). Acceleration techniques for gpu-based volume rendering. In Proceedings of the 14th IEEE Visualization 2003 (VIS'03), page 38. IEEE Computer Society.
  20. Larsen, M., Brugger, E., Childs, H., Eliot, J., Griffin, K., and Harrison, C. (2015). Strawman: A batch in situ visualization and analysis infrastructure for multi-physics simulation codes. In Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, pages 30- 35. ACM.
  21. Lorendeau, B., Fournier, Y., and Ribes, A. (2013). In-situ visualization in fluid mechanics using catalyst: A case study for code saturne. In LDAV, pages 53-57.
  22. Lösel, P. and Heuveline, V. (2016). Enhancing a diffusion algorithm for 4d image segmentation using local information. In SPIE Medical Imaging, pages 97842L97842L. International Society for Optics and Photonics.
  23. Lu, D., Zhu, D., Wang, Z., and Gao, J. (2015). Efficient level of detail for texture-based flow visualization. Computer Animation and Virtual Worlds.
  24. Ma, K. L. (2009). In situ visualization at extreme scale: Challenges and opportunities. IEEE Computer Graphics and Applications, 29(6):14-19.
  25. Malakar, P., Natarajan, V., and Vadhiyar, S. S. (2010). An adaptive framework for simulation and online remote visualization of critical climate applications in resource-constrained environments. In Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, pages 1-11. IEEE Computer Society.
  26. Morse, B. S. (2000). Lecture 4: Thresholding. Brigham Young University.
  27. Pfister, H., Lorensen, B., Bajaj, C., Kindlmann, G., Schroeder, W., Avila, L. S., Raghu, K., Machiraju, R., and Lee, J. (2001). The transfer function bakeoff. IEEE Computer Graphics and Applications, 21(3):16-22.
  28. Ressmann, D., Mexner, W., Vondrous, A., Kopmann, A., and Mauch, V. (2014). Data management at the synchrotron radiation facility anka. In 10th International Workshop on Personal Computers and Particle Accelerator Controls, PCaPAC 2014.
  29. Rivi, M., Calori, L., Muscianisi, G., and Slavnic, V. (2012). In-situ visualization: State-of-the-art and some use cases. PRACE White Paper; PRACE: Brussels, Belgium.
  30. Rosin, P. L. (2001). Unimodal thresholding. Pattern Recognition, 34(11):2083-2096.
  31. Ruiter, N., Zapf, M., Dapp, R., Hopp, T., Kaiser, W., and Gemmeke, H. (2013). First results of a clinical study with 3d ultrasound computer tomography. In 2013 IEEE International Ultrasonics Symposium (IUS), pages 651-654. IEEE.
  32. Shneiderman, B. (1996). The eyes have it: A task by data type taxonomy for information visualizations. In Visual Languages, 1996. Proceedings., IEEE Symposium on, pages 336-343. IEEE.
  33. Szalay, A. and Gray, J. (2006). 2020 computing: Science in an exponential world. Nature, 440(7083):413-414.
  34. Tu, T., Yu, H., Ramirez-Guzman, L., Bielak, J., Ghattas, O., Ma, K.-L., and O'hallaron, D. R. (2006). From mesh generation to scientific visualization: An end-to-end approach to parallel supercomputing. In Proceedings of the 2006 ACM/IEEE conference on Supercomputing, page 91. ACM.
  35. Turk, M. J., Smith, B. D., Oishi, J. S., Skory, S., Skillman, S. W., Abel, T., and Norman, M. L. (2010). yt: A multi-code analysis toolkit for astrophysical simulation data. The Astrophysical Journal Supplement Series, 192(1):9.
  36. van de Kamp, T., Vagovic?, P., Baumbach, T., and Riedel, A. (2011). A biological screw in a beetle's leg. Science, 333(6038):52-52.
  37. Williams, L. (1983). Pyramidal parametrics. In ACM Siggraph Computer Graphics, volume 17, pages 1-11. ACM.
  38. Zhang, F., Lasluisa, S., Jin, T., Rodero, I., Bui, H., and Parashar, M. (2012). In-situ feature-based objects tracking for large-scale scientific simulations. InHigh Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion:, pages 736- 740. IEEE.
  39. Zinsmaier, M., Brandes, U., Deussen, O., and Strobelt, H. (2012). Interactive level-of-detail rendering of large graphs. IEEE Transactions on Visualization and Computer Graphics, 18(12):2486-2495.

Paper Citation

in Harvard Style

Tan Jerome N., Chilingaryan S., Shkarin A., Kopmann A., Zapf M., Lizin A. and Bergmann T. (2017). WAVE: A 3D Online Previewing Framework for Big Data Archives . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, (VISIGRAPP 2017) ISBN 978-989-758-228-8, pages 152-163. DOI: 10.5220/0006228101520163

in Bibtex Style

author={Nicholas Tan Jerome and Suren Chilingaryan and Andrei Shkarin and Andreas Kopmann and Michael Zapf and Alexander Lizin and Till Bergmann},
title={WAVE: A 3D Online Previewing Framework for Big Data Archives},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, (VISIGRAPP 2017)},

in EndNote Style

JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, (VISIGRAPP 2017)
TI - WAVE: A 3D Online Previewing Framework for Big Data Archives
SN - 978-989-758-228-8
AU - Tan Jerome N.
AU - Chilingaryan S.
AU - Shkarin A.
AU - Kopmann A.
AU - Zapf M.
AU - Lizin A.
AU - Bergmann T.
PY - 2017
SP - 152
EP - 163
DO - 10.5220/0006228101520163