Evaluating an Inspection Technique for Use Case Specifications - Quantitative and Qualitative Analysis

Natasha M. Costa Valentim, Tayana Conte, José Carlos Maldonado

2015

Abstract

Usability inspections in early stages of the development process help revealing problems that can be corrected at a lower cost than at advanced stages of the development. The MIT 1 (Model Inspection Technique for Usability Evaluation) is a usability inspection technique, which aims to anticipate usability problems through the evaluation of use cases. This technique was evaluated using a controlled experiment aimed at measuring its efficiency and effectiveness, when compared to the Heuristic Evaluation (HEV) method. According to quantitative results, the MIT 1 exceeded the HEV in terms of effectiveness and obtained a similar performance in terms of efficiency. In other words, the MIT 1 allows finding more problems than the HEV. On the other hand, the subjects spent more time finding these problems using MIT 1. Moreover, the MIT 1 was considered easy to use and useful by the subjects of the study. We analysed the qualitative data using the procedures from the Grounded Theory (GT) method and results indicate improvement opportunities.

References

  1. Carver, J., Jaccheri, L., Morasca, S., Shull, F. “Issues in Using Students in Empirical Studies in Software Engineering Education”. In Proceedings of the 9th International Symposium on Software Metrics, (2003), Sydney, Australia, pp. 239 - 249.
  2. Conte, T., Massolar, J., Mendes, E., et al. “Usability Evaluation based on Web Design Perspectives”. In Proceedings of the First International Symposium on Empirical Software Engineering and Measurement, (2007), pp. 146 - 155.
  3. Conte, T., Cabral, R., Travassos, G. H. “Applying Grounded Theory in Qualitative Analysis of an Observational Study in Software Engineering - An Experience Report”. In INFOCOMP Journal of Computer Science, v.2 (1), (2009), pp. 58-69.
  4. Corbin, J and Strauss, A. Basics of Qualitative Research. Techniques and Procedures for Developing Grounded Theory. Sage, Thousand Oaks, USA (2008).
  5. Davis, F. “Perceived usefulness, perceived ease of use, and user acceptance of information technology”. In MIS Quarterly, (1989), v. 13, n. 3, pp. 319 - 339.
  6. Fernandez, A., Insfran, E., Abrahão, S. Usability evaluation methods for the web: A systematic mapping study". In: Journal of Information and Software Technology (2011), v. 53, issue 8, pp. 789 - 817.
  7. Fernandez, A., Abrahão, S., Insfran, E., Matera, M. “Further analysis on the validation of a usability inspection method for model-driven web development”. In Proceedings of International symposium on Empirical software engineering and measurement (ESEM), Lund, Sweden (2012), pp. 153- 156.
  8. Følstad, A., Law, E. L., Hornbaek, K. “Analysis in usability evaluations: an exploratory study”. In 6th Nordic Conference on Human-Computer Interaction. Reykjavik, Iceland (2010), pp. 647-650.
  9. Hornbaek, K., Høegh, R. T., Pedersen, M. B., Stage, J. “Use Case Evaluation (UCE): A Method for Early Usability Evaluation in Software Development”. In Proceedings of the 11th International Conference on Human-Computer Interaction, Rio de Janeiro (2007), pp. 578-591.
  10. ISO, International Organization for Standardization, ISO/IEC 25010, Systems and software engineering - SquaRE - Software product Quality Requirements and Evaluation - System and Software Quality Models (2011).
  11. Juristo, N., Moreno, A., Sánchez, M., Baranauskas, M. C. C. “A Glass Box Design: Making the Impact of Usability on Software Development Visible”. In Conference on Human-Computer Interaction (INTERACT), v. 4663 (2007), pp. 541 - 554.
  12. Lanubile, F., Mallardo, T., Calefato, F. “Tool support for Geographically Dispersed Inspection Teams”. In Software Process Improvement and Practice, (2003), v. 8, pp, 217 - 231.
  13. Mann, H. B., Whitney, D. R. “On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other”. In Annais of Mathematical Statistics, v. 18 (1947), pp. 50 - 60.
  14. Matera, M., Costabile, M. F., Garzotto, F., Paolini, P. “SUE Inspection: An Effective Method for Systematic Usability Evaluation of Hypermedia”. In IEEE Transactions on Systems, Man and Cybernetics, Part A, v. 32 (2002), pp. 93 - 103.
  15. Nielsen, J., “Heuristic evaluation”. “In Usability Inspection Methods (Eds. Nielsen, J., and Mack, R.L.), John Wiley & Sons, New York (1994).
  16. Seffah, A., Djouab, R., Antunes, H. “Comparing and Reconciling Usability-Centered and Use Case-Driven Requirements Engineering Processes”. In Proceedings of the 2nd Australasian conference on User interface, IEEE, Los Alamitos (2001), pp. 132 - 139.
  17. Shull, F., Carver, J., Travassos, G. H., “An empirical methodology for introducing software processes.” ACM SIGSOFT Software Engineering Notes, v. 26, n. 5, (2001), pp. 288-296.
  18. Valentim, N. M. C., Oliveira, K. M, Conte, T. “Defining an Approach for Usability Inspection in Design Models through Experimentation” (in Portuguese). In: Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems (IHC), Cuiabá - MT, 2012, pp. 165 - 174.
  19. Valentim, N. M. C., da Silva, T. S., Silveira, M. S, Conte, T. “Comparative study between usability inspection techniques about activity diagrams” (in Portuguese). In: Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems (IHC), Manaus - AM, 2013, pp. 92 - 101.
  20. Valentim, N. M. C., Conte, T. “Technical Report: Version 2 of MIT 1”, Report Number 003, (2014a). Available at: http://uses.icomp.ufam.edu.br/.
  21. Valentim, N. M. C.; Conte, T. Improving a Usability Inspection Technique based on Quantitative and Qualitative Analysis (in Portuguese). In Brazilian Symposium on Software Engineering (SBES), (2014b), pp. 171 - 180.
  22. Wöhlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., Wessl, A. “Experimentation in software engineering: an introduction”. Kluwer Academic Publishers, (2000).
Download


Paper Citation


in Harvard Style

M. Costa Valentim N., Conte T. and Maldonado J. (2015). Evaluating an Inspection Technique for Use Case Specifications - Quantitative and Qualitative Analysis . In Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 3: ICEIS, ISBN 978-989-758-098-7, pages 13-24. DOI: 10.5220/0005374100130024


in Bibtex Style

@conference{iceis15,
author={Natasha M. Costa Valentim and Tayana Conte and José Carlos Maldonado},
title={Evaluating an Inspection Technique for Use Case Specifications - Quantitative and Qualitative Analysis},
booktitle={Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 3: ICEIS,},
year={2015},
pages={13-24},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005374100130024},
isbn={978-989-758-098-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 3: ICEIS,
TI - Evaluating an Inspection Technique for Use Case Specifications - Quantitative and Qualitative Analysis
SN - 978-989-758-098-7
AU - M. Costa Valentim N.
AU - Conte T.
AU - Maldonado J.
PY - 2015
SP - 13
EP - 24
DO - 10.5220/0005374100130024