Visual Analysis of Perceptual and Cognitive Processes

Michael Raschke, Tanja Blascheck, Marianne Richter, Tanja Agapkin, Thomas Ertl

2014

Abstract

The success of visualization techniques depends on their support of perceptual and cognitive processes to perceive the graphically represented information. Apart from measuring accuracy rates of correctly given answers and completion times in user studies, eye tracking experiments provide an additional technique to analyze perceptual and cognitive processes of visual tasks. This paper presents an interdisciplinary approach for studying structures of scan paths by visual means. We propose to annotate graphical elements with semantic information. This annotation allows us to analyze the fixation sequences on these annotated graphical elements with respect to reading processes, visual search strategies, and visual reasoning.

References

  1. Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., and Qin, Y. (2004a). An integrated theory of the mind. Psychological Review, 111:1036-1060.
  2. Anderson, J. R., Bothell, D., and Douglass, S. (2004b). Eye movements do not reflect retrieval processes. Psychological Science.
  3. Andrienko, G. L., Andrienko, N. V., Burch, M., and Weiskopf, D. (2012). Visual analytics methodology for eye movement studies. IEEE Transactions Visualization Computer Graphics, 18(12):2889-2898.
  4. Burch, M., Andrienko, G. L., Andrienko, N. V., H öferlin, M., Raschke, M., and Weiskopf, D. (2013). Visual task solution strategies in tree diagrams. In Proc. IEEE PacificVIS 2013, pages 169-176.
  5. Burch, M., Konevtsova, N., Heinrich, J., Hoeferlin, M., and Weiskopf, D. (2011). Evaluation of traditional, orthogonal, and radial tree diagrams by an eye tracking study. IEEE Transactions Visualization Computer Graphics, 17(12):2440 -2448.
  6. Conversy, S., Chatty, S., and Hurter, C. (2011). Visual scanning as a reference framework for interactive representation design. Information Visualization, 10(3):196- 211.
  7. Duchowski, A. T., Driver, J., Jolaoso, S., Tan, W., Ramey, B. N., and Robbins, A. (2010). Scanpath comparison revisited. In Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications (ETRA), pages 219-226, New York, NY, USA. ACM.
  8. Grant, E. R. and Spivey, M. J. (2002). Guiding attention produces inferences in diagram-based problem solving. In Proceedings of the Second International Conference on Diagrammatic Representation and Inference, Diagrams 2002, pages 236-248, London, UK, UK. Springer-Verlag.
  9. Holmqvist, K., Nystrom, M., Andersson, R., Dewhurst, R., Jarodzka, H., and van de Weijer, J. (2011). Eye Tracking. A comprehensive guide to methods and measures. Oxford University Press.
  10. Huang, W., Eades, P., and Hong, S.-H. (2009). A graph reading behavior: Geodesic-path tendency. In Proc. IEEE PacificVIS 2013, PACIFICVIS 7809, pages 137- 144, Washington, DC, USA. IEEE Computer Society.
  11. Just, M. A. and Carpenter, P. A. (1980). A theory of reading: from eye fixations to comprehension. Psychological review, 87(4):329.
  12. Kim, S.-H., Dong, Z., Xian, H., Upatising, B., and Yi, J. S. (2012). Does an eye tracker tell the truth about visualizations?: Findings while investigating visualizations for decision making. IEEE Transactions Visualization Computer Graphics, 18(12):2421-2430.
  13. Koerner, C. (2011). Eye movements reveal distinct search and reasoning processes in comprehension of complex graphs. Applied Cognitive Psychology, 25(6):893-905.
  14. Lohse, G. L. (1993). A cognitive model for understanding graphical perception. Human-Computer Interaction, 8(4):353-388.
  15. Perini, L. (2005). The truth in pictures. Philosophy of Science, 72(1):262-285.
  16. Pinker, S. (1990). Artificial Intelligence and the Future of Testing, chapter A Theory of Graph Comprehension, pages 73-126. Lawrence Erlbaum Assoc Inc.
  17. Ponsoda, V., Scott, D., and Findlay, J. (1995). A probability vector and transition matrix analysis of eye movements during visual search. Acta Psychologica, 88(2):167 - 185.
  18. Ramloll, R., Trepagnier, C., Sebrechts, M., and Beedasy, J. (2004). Gaze data visualization tools: Opportunities and challenges. In Proceedings of the Information Visualization, Eighth International Conference, pages 173-180, Washington, DC, USA. IEEE Computer Society.
  19. Raschke, M., Chen, X., and Ertl, T. (2012). Parallel scanpath visualization. In Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA 7812, pages 165-168, New York, NY, USA. ACM.
  20. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological bulletin, 124(3):372-422.
  21. Shah, P. (1997). A model of the cognitive and perceptual processes in graphical display comprehension. In Proc. American Association for Artificial Intelligence Spring Symposium, AAAI Technical Report FS-97-03. Stanford University.
  22. Spakov, O. and Miniotas, D. (2007). Visualization of eye gaze data using heat maps. Electronics and Electrical Engineering / Elektronika ir Elektrotechnika, pages 55-58.
  23. Tsang, H. Y., Tory, M., and Swindells, C. (2010). eSeeTrackvisualizing sequential fixation patterns. IEEE Transactions on Visualization and Computer Graphics, 16(6):953-62.
  24. Wooding, D. S. (2002). Fixation maps: quantifying eyemovement traces. In Proceedings of the 2002 symposium on Eye tracking research & applications, ETRA 7802, pages 31-36, New York, NY, USA. ACM.
Download


Paper Citation


in Harvard Style

Raschke M., Blascheck T., Richter M., Agapkin T. and Ertl T. (2014). Visual Analysis of Perceptual and Cognitive Processes . In Proceedings of the 5th International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2014) ISBN 978-989-758-005-5, pages 284-291. DOI: 10.5220/0004687802840291


in Bibtex Style

@conference{ivapp14,
author={Michael Raschke and Tanja Blascheck and Marianne Richter and Tanja Agapkin and Thomas Ertl},
title={Visual Analysis of Perceptual and Cognitive Processes},
booktitle={Proceedings of the 5th International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2014)},
year={2014},
pages={284-291},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004687802840291},
isbn={978-989-758-005-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2014)
TI - Visual Analysis of Perceptual and Cognitive Processes
SN - 978-989-758-005-5
AU - Raschke M.
AU - Blascheck T.
AU - Richter M.
AU - Agapkin T.
AU - Ertl T.
PY - 2014
SP - 284
EP - 291
DO - 10.5220/0004687802840291