A GUI Modeling DSL for Pattern-Based GUI Testing - PARADIGM

Rodrigo M. L. M. Moreira, Ana C. R. Paiva

2014

Abstract

Today’s software feature user interface (UI) patterns. Those patterns describe generic solutions for common recurrent problems. However, to the best of our knowledge, there is no specific testing methodology that is particularly suited for testing those patterns providing generic testing solutions that can be reused after minor configurations in order to test slightly different implementations. Pattern-Based Graphical User Interface Testing (PBGT) is a recent methodology that aims at systematizing and automating the GUI testing process, by sampling the input space using “UI Test Patterns” that express generic solutions to test common recurrent GUI’s behaviour. This paper describes the development process of PARADIGM, a domain specific language (DSL) to be used in the context of PBGT and empirically evaluates PARADIGM to assess its diminished modeling efforts, usefulness, graphical power, and acceptability.

References

  1. Brucker, A. D. and Doser, J. (2007). Metamodel-based UML Notations for Domain-specific Languages. In Favre, J. M., Gasevic, D., Lämmel, R., and Winter, A., editors, 4th International Workshop on Software Language Engineering (ATEM 2007). Nashville, USA.
  2. Cabot, J. and Gogolla, M. (2012). Object constraint language (OCL): a definitive guide. In Proceedings of the 12th international conference on Formal Methods for the Design of Computer, Communication, and Software Systems: formal methods for model-driven engineering, SFM'12, pages 58-90, Berlin, Heidelberg. Springer-Verlag.
  3. Constantine, L. (2003). Canonical Abstract Prototypes for Abstract Visual and Interaction Design. In Interactive Systems. Design, Specification, and Verification, volume 2844 of LNCS, pages 1-15. Springer-Verlag, Berlin/Heidelberg.
  4. Cook, S., Jones, G., Kent, S., and Wills, A. (2007). DomainSpecific Development with Visual Studio DSL Tools. Addison-Wesley Professional, first edition.
  5. Cunha, M., Paiva, A. C. R., Sereno Ferreira, H., and Abreu, R. (2010). PETTool: A Pattern-Based GUI Testing Tool. In 2nd International Conference on Software Technology and Engineering (ICSTE'10), SFM'12, pages 202-206.
  6. Fowler, M. (2010). Domain Specific Languages. AddisonWesley Professional, 1st edition.
  7. Grandite (2008). Open Modelsphere - Free Modeling Software Open Source GPL. http://www.modelsphere.org/. Accessed January, 2013.
  8. Gronback, R. C. and Boldt, N. (2013). Graphical Modeling Framework. http://www.eclipse.org/modeling/gmp. Accessed April, 2013.
  9. Jackson, D. (2011). Software Abstractions: Logic, Language, and Analysis. MIT Press; 2nd Revised edition.
  10. Karsai, G., Krahn, H., Pinkernell, C., Rumpe, B., Schneider, M., and Vlkel, S. (2009). Design Guidelines for Domain Specific Languages. In Rossi, M., Sprinkle, J., Gray, J., and Tolvanen, J.-P., editors, Proceedings of the 9th OOPSLA Workshop on Domain-Specific Modeling (DSM'09), pages 7-13.
  11. Memon, A. M., Soffa, M. L., and Pollack, M. E. (2001). Coverage Criteria for GUI Testing. In In Proceedings of the 8th European Software Engineering Conference (ESEC) and 9th ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE-9), pages 256-267. ACM Press.
  12. Microsoft (2012). Model-based Testing with SpecExplorer - Microsoft Research. http://research.microsoft.com/enus/projects/specexplorer/. Accessed February, 2012.
  13. Microsoft (2013). Spec# - Microsoft Research. http://research.microsoft.com/enus/projects/specsharp/. Accessed January, 2013.
  14. Monteiro, T. and Paiva, A. C. R. (2013). Pattern Based GUI Testing Modeling Environment. In ICST Workshops, pages 140-143.
  15. Moody, D. (2007). What Makes a Good Diagram? Improving the Cognitive Effectiveness of Diagrams in IS Development. In Wojtkowski, W., Wojtkowski, W., Zupancic, J., Magyar, G., and Knapp, G., editors, Advances in Information Systems Development, pages 481-492. Springer US.
  16. Moreira, R. M. L. M. and Paiva, A. C. R. (2008). Visual Abstract Notation for GUI Modelling and Testing - VAN4GUIM. In Cordeiro, J., Shishkov, B., Ranchordas, A., and Helfert, M., editors, ICSOFT (SE/MUSE/GSDCA), pages 104-111. INSTICC Press.
  17. Moreira, R. M. L. M., Paiva, A. C. R., and Memon, A. (2013). A Pattern-Based Approach for GUI Modeling and Testing. In Proceedings of the 24th International Symposium on Software Reliability Engineering, ISSRE'13, Pasadena, CA, USA. IEEE Computer Society.
  18. Paiva, A., Faria, J. C. P., and Vidal, R. F. A. M. (2003). Specification-Based Testing of User Interfaces. In Interactive Systems. Design, Specification, and Verification, 10th International Workshop, volume 2844 of LNCS, pages 139-153. Springer.
  19. Paiva, A. C., Faria, J. C., Tillmann, N., and Vidal, R. A. (2005). A Model-to-Implementation Mapping Tool for Automated Model-Based GUI Testing. In Lau, K.-K. and Banach, R., editors, Formal Methods and Software Engineering, volume 3785 of LNCS, pages 450-464. Springer Berlin Heidelberg.
  20. Paternò, F., Mancini, C., and Meniconi, S. (1997). ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models. In Proceedings of the IFIP TC13 International Conference on Human-Computer Interaction, INTERACT 7897, pages 362-369, London, UK, UK. Chapman & Hall, Ltd.
  21. Rubel, D., Wren, J., and Clayberg, E. (2011). The Eclipse Graphical Editing Framework (GEF). AddisonWesley Professional, 1st edition.
  22. Runeson, P. and Höst, M. (2009). Guidelines for conducting and reporting case study research in software engineering. Empirical Software Engineering, 14(2):131- 164.
  23. StarUML (2005). Staruml - The Open Source UML/MDA Platform. http://staruml.sourceforge.net/en/. Accessed January, 2013.
  24. Steinberg, D., Budinsky, F., Paternostro, M., and Merks, E. (2009). EMF: Eclipse Modeling Framework 2.0. Addison-Wesley Professional, 2nd edition.
  25. Strembeck, M. and Zdun, U. (2009). An approach for the systematic development of domain-specific languages. Softw. Pract. Exper., 39(15):1253-1292.
Download


Paper Citation


in Harvard Style

M. L. M. Moreira R. and C. R. Paiva A. (2014). A GUI Modeling DSL for Pattern-Based GUI Testing - PARADIGM . In Proceedings of the 9th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, ISBN 978-989-758-030-7, pages 126-135. DOI: 10.5220/0004880601260135


in Bibtex Style

@conference{enase14,
author={Rodrigo M. L. M. Moreira and Ana C. R. Paiva},
title={A GUI Modeling DSL for Pattern-Based GUI Testing - PARADIGM},
booktitle={Proceedings of the 9th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,},
year={2014},
pages={126-135},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004880601260135},
isbn={978-989-758-030-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,
TI - A GUI Modeling DSL for Pattern-Based GUI Testing - PARADIGM
SN - 978-989-758-030-7
AU - M. L. M. Moreira R.
AU - C. R. Paiva A.
PY - 2014
SP - 126
EP - 135
DO - 10.5220/0004880601260135