PLAIN: PLugin for predicting the usAbility of Mobile User INterface

Makram Soui, Mabrouka Chouchane, Ines Gasmi, Mohamed Wiem Mkaouer


Mobile user interfaces have the potential to improve the interaction between user and system by automatically tailoring the graphical user interface presentation according to the mobile devices. Recently, there is a myriad of works that addressed the problem of designing mobile user interfaces to various contexts of use. But, there are very few proposals about evaluating their quality. Using existing evaluation methods such as questionnaires and experts’ evaluation are time-consuming and error-prone. In this paper, we propose an automatic evaluation plugin that allows detecting the defects related to the quality of mobile user interface. The plugin allows the measurement of several metrics that have been known to constitute the state of the art quality attributes that are used to predict the quality of interfaces from the usability perspective. For a given input mobile applications, it generates a list of defects identified using quantitative evaluation metrics and defects types. We evaluated our plugin on four open source mobile applications and the obtained results confirm that our tool can be used to accurately evaluate the quality of interfaces.


  1. Akiki, P. A., Bandara, A. K. & Yu, Y. (2015) Adaptive model-driven user interface development systems. ACM Computing Surveys 47.
  2. Alemerien, K. & Magel, K. (2014) GUIEvaluator: A Metric-tool for Evaluating the Complexity of Graphical User Interfaces. In: SEKE, pp. 13-18.
  3. Alemerien, K. & Magel, K. (2015) SLC: a visual cohesion metric to predict the usability of graphical user interfaces. In: Proceedings of the 30th Annual ACM Symposium on Applied Computing, pp. 1526-1533. ACM.
  4. Buanga, P. M. (2011) Automated evalution of graphical user interface metrics.
  5. Charfi, S., Ezzedine, H. & Kolski, C. (2015) RITA: a useR Interface evaluaTion frAmework. Journal of Universal Computer Science 21, 526-560.
  6. expriment (2016)
  7. Gajos, K. Z., Everitt, K., Tan, D. S., Czerwinski, M. & Weld, D. S. (2008) Predictability and accuracy in adaptive user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1271-1274. ACM.
  8. Gena, C. (2005) Methods and techniques for the evaluation of user-adaptive systems. The Knowledge Engineering Review 20, 1-37.
  9. González, S., Montero, F. & González, P. (2012) BaLOReS: a suite of principles and metrics for graphical user interface evaluation. In: Proceedings of the 13th International Conference on Interacción Persona-Ordenador, pp. 9. ACM.
  10. Hellmann, T. D. & Maurer, F. (2011) Rule-based exploratory testing of graphical user interfaces. In: Agile Conference (AGILE), 2011, pp. 107-116. IEEE.
  11. Hubert, M. & Vandervieren, E. (2008) An adjusted boxplot for skewed distributions. Computational statistics & data analysis 52, 5186-5201.
  12. Magoulas, G. D., Chen, S. Y. & Papanikolaou, K. A. (2003) Integrating layered and heuristic evaluation for adaptive learning environments. In: Proceedings of the Second Workshop on Empirical Evaluation of Adaptive Systems, held at the 9th International Conference on User Modeling UM2003, Pittsburgh, pp. 5-14.
  13. Masi, E., Cantone, G., Mastrofini, M., Calavaro, G. & Subiaco, P. (2012) Mobile apps development: A framework for technology decision making. In: International Conference on Mobile Computing, Applications, and Services, pp. 64-79. Springer.
  14. Mulwa, C., Lawless, S., Sharp, M. & Wade, V. (2011) The evaluation of adaptive and personalised information retrieval systems: a review. International Journal of Knowledge and Web Intelligence 2, 138-156.
  15. Myers, B. A. (1995) User interface software tools. ACM Transactions on Computer-Human Interaction (TOCHI) 2, 64-103.
  16. Ngo, D., Teo, L. & Byrne, J. (2000) Formalising guidelines for the design of screen layouts. Displays 21, 3-15.
  17. Nguyen, B. N., Robbins, B., Banerjee, I. & Memon, A. (2014) GUITAR: an innovative tool for automated testing of GUI-driven software. Automated Software Engineering 21, 65-105.
  18. Park, J., Han, S. H., Kim, H. K., Cho, Y. & Park, W. (2013) Developing elements of user experience for mobile phones and services: survey, interview, and observation approaches. Human Factors and Ergonomics in Manufacturing & Service Industries 23, 279-293.
  19. Pascual, G. G., Pinto, M. & Fuentes, L. (2015) Selfadaptation of mobile systems driven by the common variability language. Future Generation Computer Systems 47, 127-144.
  20. Soui, M., Abed, M., Kolski, C. & Ghédira, K. (2010) Evaluation by simulation for personalized information systems. In: 8th International Conference of Modeling and Simulation, MOSIM'10" Evaluation and optimization of innovative production systems of goods and services, pp. 10-12.
  21. Soui, M., Abed, M., Kolski, C. & Ghèdira, K. (2012) Evaluation by simulation to optimise information systems' personalisation quality in logistics. International Journal of Production Research 50, 3579-3593.
  22. Stober, S., Hentschel, C. & Nürnberger, A. (2010) Evaluation of adaptive SpringLens: a multi-focus interface for exploring multimedia collections. In: Proceedings of the 6th Nordic Conference on HumanComputer Interaction: Extending Boundaries, pp. 785- 788. ACM.
  23. Van Velsen, L., Van Der Geest, T., Klaassen, R. & Steehouder, M. (2008) User-centered evaluation of adaptive and adaptable systems: a literature review. The Knowledge Engineering Review 23, 261-281.
  24. Vos, T. E., Kruse, P. M., Condori-Fernández, N., Bauersfeld, S. & Wegener, J. (2015) Testar: Tool support for test automation at the user interface level. International Journal of Information System Modeling and Design (IJISMD) 6, 46-83.
  25. Zen, M. & Vanderdonckt, J. (2014) Towards an evaluation of graphical user interfaces aesthetics based on metrics. In: 2014 IEEE Eighth International Conference on Research Challenges in Information Science (RCIS), pp. 1-12. IEEE.

Paper Citation

in Harvard Style

Soui M., Chouchane M., Gasmi I. and Mkaouer M. (2017). PLAIN: PLugin for predicting the usAbility of Mobile User INterface . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017) ISBN 978-989-758-224-0, pages 127-136. DOI: 10.5220/0006171201270136

in Bibtex Style

author={Makram Soui and Mabrouka Chouchane and Ines Gasmi and Mohamed Wiem Mkaouer},
title={PLAIN: PLugin for predicting the usAbility of Mobile User INterface},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)},

in EndNote Style

JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)
TI - PLAIN: PLugin for predicting the usAbility of Mobile User INterface
SN - 978-989-758-224-0
AU - Soui M.
AU - Chouchane M.
AU - Gasmi I.
AU - Mkaouer M.
PY - 2017
SP - 127
EP - 136
DO - 10.5220/0006171201270136