An Empirical Analysis of the Correlation between CK Metrics, Test Coverage and Mutation Score

Robinson Crusoé da Cruz, Marcelo Medeiros Eler

2017

Abstract

: In this paper we investigate the correlation between test coverage, mutation score and object-oriented systems metrics. First we conducted a literature review to obtain an initial model of testability and existing object-oriented metrics related to testability. Thus we selected four open source system whose test cases were available and calculated the correlation between the metrics collected and the line coverage, branches coverage and mutation score. Preliminary results show that some CK metrics, which are strongly related to system’s design, influence mainly line coverage and mutation score, thus they can influence systems testability.

References

  1. Abdullah, R. S. and Khan, M. H. (2013). Testability estimation of object oriented design:a revisit. International Jounal of Advanced Research in Computer and Communication Engineering, pages 3086-3090, numpages = 5,.
  2. Badri, L. and Tour, F. (2011). An empirical analysis of lack of cohesion metrics for predictiong testability of classes. International Journal of Software Engineering and its Application.
  3. Badri, M. and Toure, F. (2012). Empirical analysis of object-oriented design metrics for predicting unit testing. Journal of Software Engineering and Applications, pages 513-526.
  4. Binder, R. V. (1994). Design for testability in objectoriented systems. Commun. ACM, 37(9):87-101.
  5. Bruntink, M. and van Deursen, A. (2004). Predicting class testability using object-oriented metrics. Source Code Analysis and Manipulation, 2004. Fourth IEEE International Workshop on, pages 136-145.
  6. Bruntink, M. and van Deursen, A. (2006). An empirical study into class testability. J. Syst. Softw., 79(9):1219- 1232.
  7. Chidamber, S. and Kemerer, C. (1994). A metrics suite for object oriented design. Software Engineering, IEEE Transactions on, 20(6):476-493.
  8. de Castro, C. F., de Souza Oliveira Jr, D., and Eler, M. M. (2016). Identifying characteristics of java methods that may influence branch coverage: An exploratory study on open source projects. In Proceedings of the 35th International Conference of the Chilean Computer Science Society (SCCC 2016). IEEE.
  9. IEEE (1990). Ieee standard glossary of software engineering terminology. IEEE Std 610.12-1990, pages 1-84.
  10. ISO (1991). International standard ISO/IEC 9126. information technology:Software product evaluation: Quality characteristics and quidelines for their use. ISO.
  11. Khalid, S., Zehra, S., and Arif, F. (2010). Analysis of object oriented complexity and testability using object oriented design metrics. In Proceedings of the 2010 National Software Engineering Conference, NSEC 7810, pages 4:1-4:8, New York, NY, USA. ACM.
  12. Khan, R. A. and Mustafa, K. (2009). Metric based testability model for object oriented design (mtmood). SIGSOFT Softw. Eng. Notes, 34(2):1-6.
  13. Kout, A., Toure, F., and Badri, M. (2011). An empirical analysis of a testability model for object-oriented programs. SIGSOFT Softw. Eng. Notes, 36(4):1-5.
  14. Li, W. (1999). Software product metrics. Potentials, IEEE, 18(5):24-27.
  15. Lorenzen, M. and Kidd, J. (1994). Object-oriented software metrics : a practical guide. Prentice Hall objectoriented series, Englewood Cliffs, NJ. PTR Prentice Hall.
  16. McCabe, T. J. (1976). A complexity measure. In Proceedings of the 2Nd International Conference on Software Engineering, ICSE 7876, page 407, Los Alamitos, CA, USA. IEEE Computer Society Press.
  17. Offutt, A. J. (1994). A practical system for mutation testing: help for the common programmer. In Test Conference, 1994. Proceedings., International, pages 824-830.
  18. Offutt, A. J., Pan, J., Tewary, K., and Zhang, T. (1996). An experimental evaluation of data flow and mutation testing. Softw. Pract. Exper., 26(2):165-176.
  19. Sneed, H. M. (2010). Testing object-oriented software systems. In Proceedings of the 1st Workshop on Testing Object-Oriented Systems, ETOOS 7810, pages 1:1-1:5, New York, NY, USA. ACM.
  20. Tahir, A., MacDonell, S. G., and Buchan, J. (2014). Understanding class-level testability through dynamic analysis. In Evaluation of Novel Approaches to Software Engineering (ENASE), 2014 International Conference on, pages 1-10.
  21. Zhu, H., Hall, P. A. V., and May, J. H. R. (1997). Software unit test coverage and adequacy. ACM Comput. Surv., 29(4):366-427.
Download


Paper Citation


in Harvard Style

da Cruz R. and Medeiros Eler M. (2017). An Empirical Analysis of the Correlation between CK Metrics, Test Coverage and Mutation Score . In Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-248-6, pages 341-350. DOI: 10.5220/0006312703410350


in Bibtex Style

@conference{iceis17,
author={Robinson Crusoé da Cruz and Marcelo Medeiros Eler},
title={An Empirical Analysis of the Correlation between CK Metrics, Test Coverage and Mutation Score},
booktitle={Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2017},
pages={341-350},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006312703410350},
isbn={978-989-758-248-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - An Empirical Analysis of the Correlation between CK Metrics, Test Coverage and Mutation Score
SN - 978-989-758-248-6
AU - da Cruz R.
AU - Medeiros Eler M.
PY - 2017
SP - 341
EP - 350
DO - 10.5220/0006312703410350