Predictive Cognitive Modelling of Applications

Sabine Prezenski, Dominik Bruechner, Nele Russwinkel

2017

Abstract

This paper argues that important usability aspects of mobile applications can be automatically evaluated using computational cognitive models based on the cognitive architecture ACT-R. A tool incorporating cognitive models for specific tasks, users, applications and usability aspects is proposed. Explanations provided by the tool for usability flaws are based on simulations of cognitive mechanisms. A use-case of the tool is introduced, which is based on an ACT-R model that simulates how users search and select a specific target in a hierarchical android application and predicts efficiency and learnability for average users. The model has been empirically validated in four studies with two different applications. To fully automate the usability evaluation of the use-case, two basic requirements need to be fulfilled. First, the application and the cognitive model have to be connected. A tool called ACT-Droid acts as an interface between the Android application and the cognitive model. Second, the models knowledge of the world, which is application specific, has to be provided automatically by using an automated user interface analysation approach. Therefore, the open-source tool AppCrawler was extended to allow the extraction of the required information.

References

  1. Amalfitano, D., Fasolino, A. R., Tramontana, P., De Carmine, S., and Memon, A. M. (2012). Using gui ripping for automated testing of android applications. In Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering, ASE 2012, pages 258-261, New York, NY, USA. ACM.
  2. Anderson, J. R. (2007). How can the human mind occur in the physical universe? Oxford University Press, USA.
  3. AppBrain (2016). Number of available android applications. https://www.appbrain.com/stats/number-ofandroid-apps. Retrieved 2016-01.
  4. Byrne, M. D., Anderson, J. R., Douglass, S., and Matessa, M. (1999). Eye tracking the visual search of clickdown menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 7899, pages 402-409, New York, NY, USA. ACM.
  5. Choi, W., Necula, G., and Sen, K. (2013). Guided gui testing of android apps with minimal restart and approximate learning. SIGPLAN Not., 48(10):623-640.
  6. Cormen, T. H. (2009). Introduction to algorithms, chapter 22.3: Depth-first search, pages 540-549. MIT press.
  7. Das, A. and Stuerzlinger, W. (2007). A cognitive simulation model for novice text entry on cell phone keypads. In Proceedings of the 14th European Conference on Cognitive Ergonomics: Invent! Explore!, ECCE 7807, pages 141-147, New York, NY, USA. ACM.
  8. Dörr, L.-M., Russwinkel, N., and Prezenski, S. (2016). Actdroid: Act-r interacting with android applications. In Reiter, D. and Ritter, F. E., editors, Proceedings of the 14th International Conference on Cognitive Modeling (ICCM 2016), pages 225-227, University Park, PA: Penn State.
  9. Gallagher, M. A. and Byrne, M. D. (2015). Modeling password entry on a mobile device. In Proceedings of the 2015 International Conference on Cognitive Modeling.
  10. Greene, K. K., Tamborello, F. P., and Micheals, R. J. (2013). Computational cognitive modeling of touch and gesture on mobile multitouch devices: Applications and challenges for existing theory. In International Conference on Human-Computer Interaction, pages 449- 455. Springer.
  11. Harrison, R., Flood, D., and Duce, D. (2013). Usability of Mobile Applications: Literature Review and Rationale for a New Usability Model. Journal of Interaction Science, 1(1):1.
  12. John, B. E., Prevas, K., Salvucci, D. D., and Koedinger, K. (2004). Predictive human performance modeling made easy. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 455- 462. ACM.
  13. Nielsen, J. (1994). Enhancing the explanatory power of usability heuristics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 7894, pages 152-158, New York, NY, USA. ACM.
  14. Prezenski, S. and Russwinkel, N. (2016). Towards a general model of repeated app usage. In Reiter, D. and Ritter, F. E., editors, Proceedings of the 14th International Conference on Cognitive Modeling (ICCM 2016), pages 201-207, University Park, PA: Penn State.
  15. Raufaste, E. (2006). Air traffic control in act-r: A computational model of conflict detection between planes. In Proceedings of the International Conference on Human-Computer Interaction in Aeronautics (HCIAero'06), pages 258-259.
  16. Ritter, S., Anderson, J. R., Koedinger, K. R., and Corbett, A. (2007). Cognitive tutor: Applied research in mathematics education. Psychonomic bulletin & review, 14(2):249-255.
  17. Teo, L. and John, B. E. (2008). Cogtool-explorer: towards a tool for predicting user interaction. In CHI'08 Extended Abstracts on Human Factors in Computing Systems, pages 2793-2798. ACM.
Download


Paper Citation


in Harvard Style

Prezenski S., Bruechner D. and Russwinkel N. (2017). Predictive Cognitive Modelling of Applications . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: HUCAPP, (VISIGRAPP 2017) ISBN 978-989-758-229-5, pages 165-171. DOI: 10.5220/0006273301650171


in Bibtex Style

@conference{hucapp17,
author={Sabine Prezenski and Dominik Bruechner and Nele Russwinkel},
title={Predictive Cognitive Modelling of Applications},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: HUCAPP, (VISIGRAPP 2017)},
year={2017},
pages={165-171},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006273301650171},
isbn={978-989-758-229-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: HUCAPP, (VISIGRAPP 2017)
TI - Predictive Cognitive Modelling of Applications
SN - 978-989-758-229-5
AU - Prezenski S.
AU - Bruechner D.
AU - Russwinkel N.
PY - 2017
SP - 165
EP - 171
DO - 10.5220/0006273301650171