Using the Dependence Level Among Requirements to Priorize the Regression Testing Set and Characterize the Complexity of Requirements Change

André Di Thommazo, Kamilla Camargo, Elis Hernandes, Gislaine Gonçalves, Jefferson Pedro, Anderson Belgamo, Sandra Fabbri

2015

Abstract

Background: When there are changes in software requirements, other phases of software development are impacted and frequently, extra effort is needed to adjust the previous developed artifacts to new features or changes. However, if the development team has the traceability of requirements, the extra effort could be not an issue. An example is the software quality team, which needs to define effective tests cycles in each software release. Goal: This papers aims to present an approach based on requirements dependence level to support the regression test prioritization and identify the real impact of requirement changes. Method: The designed approach is based on automatic definition of Requirements Traceability Matrix with three different dependence levels. Moreover, dependence between requirement and test case is also defined. A case study in a real software development industry environment was performed to assess the approach. Results: Identifying the dependence level among requirements have allowed the quality assurance team priorize regression tests and, by means of these tests, defects are early identified if compared with tests execution without priorization. Moreover, the requirements changes complexity is also identified with the approach support. Conclusion: Results shows that definition of dependence levels among requirements gives two contributions: (i) allowing test prioritization definition, which become regression test cycle more effective, (ii) allowing characterize impacts of requirements changes, which is commonly requested by stakeholders.

References

  1. Cleland-Huang, J., Gotel, O., Zisman, A. (2012) Software and Systems Traceability, Springer, Berlin.
  2. Di Thommazo, A., Malimpensa, G., Olivatto, G. , Ribeiro, T., Fabbri, S. (2012). Requirements Traceability Matrix: Automatic Generation and Visualization. In: Brazilian Symposium on Software Engineering, SBES, Natal, Brazil, Sep. 2012. Los Alamitos: IEEE Press.
  3. Di Thommazo, A., Ribeiro, T., Olivatto, G., Rovina, R., Werneck, V., Fabbri, S. (2013a) Detecting traceability links through neural networks. In: International Conference on Software Engineering and Knowledge Engineering, SEKE, Boston, USA. July 2013. Illinois: Knowledge Systems Institute.
  4. Di Thommazo, A., Ribeiro, T., Olivatto, G., Werneck, V., Fabbri, S. (2013b) An automatic approach to detect traceability links using fuzzy logic. In: Brazilian Symposium on Software Engineering, SBES, Brasília, Brazil, Sep. 2013. Los Alamitos: IEEE Press.
  5. Di Thommazo, A., Rovina, R., Ribeiro, T., Olivatto, G., Hernandes, E., Werneck, V., Fabbri, S. (2014) Using artificial intelligence techniques to enhance traceability links. In: International Conference on Enterprise Information Systems, ICEIS, Lisboa, Portugal. April 2013. Lisboa: INSTIC Press.
  6. Engström et al. A Systematic Review on Regression Test Selection Techniques (2010) Information and Software Technology, 52, 1, 2010, p. 14-30
  7. Filho et al. Supporting concern based regression testing and prioritization in a model driven environment (2010). In: Annual Computer Software and Applications Conference Workshop, COMPSAC, Seul, July 2010. New York: ACM Press.
  8. Goknil, A., Kurtev, I., Van den Berg, K., Veldhuis, J. W. (2011) Semantics of Trace Relations in Requirements Models for Consistency Checking and Inferencing. Software and Systems Modeling, 10, 1, Feb. 2011.
  9. Götel, O., Finkelstein, A. (1997) Extended requirements traceability: results of an industrial case study In: Third IEEE International Symposium on Requirements Engineering, Annapolis, USA
  10. Guo, Y., Yang, M, Wang, J., Yang, P., Li, F. (2009) An Ontology based Improved Software Requirement Traceability Matrix. In: International Symposium on Knowledge Acquisition and Modeling, KAM , Wuhan, China, Nov. 2009, Los Alamitos: IEEE Press.
  11. IBM. (2012) Ten Steps to Better Requirements Management. Available at: http://public.dhe.ibm.com/common/ssi/ ecm/en/raw14059usen/RAW14059USEN.PDF. (Accessed: 18 January 2015).
  12. Kawai, K. K. (2005) Guidelines for preparation of requirements document with emphasis on the Functional Requirements (in portuguese). Master in Computer Science, Federal University of São Carlos, Brasil, 170 f.
  13. Kama, N.; Azli, F. (2012) A Change Impact Analysis Approach for the Software Development Phase. In: Asia-Pacific Software Engineering Conference, APSEC, Hong Kong, Dec. 2012. New York: ACM Press.
  14. Kukreja, N.; Halfond, W.G.J.; Tambe, M. (2013) Randomizing regression tests using game theory. In: IEEE/ACM International Conference on Automated Software Engineering, ASE, San Francisco, USA, Nov. 2013, Los Alamitos: IEEE Press.
  15. Maheswari, R. U.; JeyaMala, D., "A novel approach for test case prioritization. (2013). In: IEEE International Conference on Computational Intelligence and Computing Research, ICCIC, Tamilnadu, India, Dec. 2013, Los Alamitos: IEEE Press.
  16. Malz, C.; Jazdi, N.; Gohner, P. (2012) Prioritization of Test Cases Using Software Agents and Fuzzy Logic. In: IEEE Software Testing, Verification and Validation, ICST, Montreal, Canada, Apr. 2012, Los Alamitos: IEEE Press.
  17. Myers, G. J. et al. (2004) The art of software testing. Nova Jersey: John Wiley and Sons, 2004.
  18. Oliveto, R.; Antoniol, G.; Marcus, A.; Hayes, J. (2007) Software Artefact Traceability: the Never-Ending Challenge. In: IEEE International Conference on Software Maintenance, ICSM, Paris, Oct. 2007, Los Alamitos: IEEE Press, pp.485,488.
  19. Rothermel, G.; UnCTh, R.H.; Chengyun Chu; Harrold, M.J. (2001) Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering, 27, 10. October 2001. pp.929,948
  20. Sundaram, S.K.A., Hayes, J.H.B., Dekhtyar, A.C., Holbrook, E.A.D. (2010) Assessing Traceability of Software Engineering Artifacts. In” International IEEE Requirements Engineering Conference, Sydney, Australia, Sep. 2010, Los Alamitos: IEEE Press.
  21. Salem, A. M. (2006) Improving Software Quality through Requirements Traceability Models. In: ACS/IEEE Int. Conf. Computer Systems and Applications, AICCSA, Dubai, Sharjah, March 2006. Los Alamitos: IEEE Press.
  22. Salem, Y. I.; Hassan, R. (2010) Requirement-based test case generation and prioritization. In: Computer Engineering Conference, ICENCO, Giza, Egypt, Dec, 2010, Los Alamitos: IEEE Press.
  23. Singh et al. Systematic Literature Review on Regression Test Prioritization Techniques (2012). Informatica, 36, 2012, p. 379-408
  24. Sommerville, I. (2010) Software Engineering. Addison Wesley, New York, 9th edition
  25. Srikanth, H.; Williams, L.; Osborne, J. (2005) System test case prioritization of new and regression test cases. In: International Symposium on Empirical Software Engineering, Noosa Heads, Australia, November 2005. Los Alamitos, IEEE Press.
  26. Zisman, A., Spanoudakis, G. (2004) Software Traceability: Past, Present, and Future. The Newsletter of the Requirements Engineering Specialist Group of the British Computer Society, September 2004.
Download


Paper Citation


in Harvard Style

Di Thommazo A., Camargo K., Hernandes E., Gonçalves G., Pedro J., Belgamo A. and Fabbri S. (2015). Using the Dependence Level Among Requirements to Priorize the Regression Testing Set and Characterize the Complexity of Requirements Change . In Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-097-0, pages 231-241. DOI: 10.5220/0005468902310241


in Bibtex Style

@conference{iceis15,
author={André Di Thommazo and Kamilla Camargo and Elis Hernandes and Gislaine Gonçalves and Jefferson Pedro and Anderson Belgamo and Sandra Fabbri},
title={Using the Dependence Level Among Requirements to Priorize the Regression Testing Set and Characterize the Complexity of Requirements Change},
booktitle={Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2015},
pages={231-241},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005468902310241},
isbn={978-989-758-097-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Using the Dependence Level Among Requirements to Priorize the Regression Testing Set and Characterize the Complexity of Requirements Change
SN - 978-989-758-097-0
AU - Di Thommazo A.
AU - Camargo K.
AU - Hernandes E.
AU - Gonçalves G.
AU - Pedro J.
AU - Belgamo A.
AU - Fabbri S.
PY - 2015
SP - 231
EP - 241
DO - 10.5220/0005468902310241