Test Suite Minimization of Evolving Software Systems: A Case Study

Amit Goyal, R. Shyamasundar, Raoul Jetley, Devina Mohan, Srini Ramaswamy

2019

Abstract

Test suite minimization ensures that an optimum set of test cases are selected to provide maximum coverage of requirements. In this paper, we discuss and evaluate techniques for test suite minimization of evolving software systems. As a case study, we have used an industrial tool, Static Code Analysis (SCAN) tool for Electronic Device Description Language (EDDL) as the System Under Test (SUT). We have used standard approaches including Greedy, Greedy Essential (GE) and Greedy Redundant Essential (GRE) for minimization of the test suite for a given set of requirements of the SUT. Further, we have proposed and implemented k-coverage variants of these approaches. The minimized test suite which is obtained as a result reduces testing effort and time during regression testing. The paper also addresses the need for choosing an appropriate level of granularity of requirements to efficiently cover all requirements. The paper demonstrates how fine grained requirements help in finding an optimal test suite to completely address the requirements and also help in detecting bugs in each version of the software. Finally, the results from different analyses have been presented and compared and it has been observed that GE heuristics performs the best (run time) under certain conditions.

Paper Citation

in Harvard Style

Goyal A., Shyamasundar R., Jetley R., Mohan D. and Ramaswamy S. (2019). Test Suite Minimization of Evolving Software Systems: A Case Study.In Proceedings of the 14th International Conference on Software Technologies - Volume 1: ICSOFT, ISBN 978-989-758-379-7, pages 226-237. DOI: 10.5220/0007842502260237

in Bibtex Style

@conference{icsoft19,
author={Amit Goyal and R. Shyamasundar and Raoul Jetley and Devina Mohan and Srini Ramaswamy},
title={Test Suite Minimization of Evolving Software Systems: A Case Study},
booktitle={Proceedings of the 14th International Conference on Software Technologies - Volume 1: ICSOFT,},
year={2019},
pages={226-237},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007842502260237},
isbn={978-989-758-379-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Software Technologies - Volume 1: ICSOFT,
TI - Test Suite Minimization of Evolving Software Systems: A Case Study
SN - 978-989-758-379-7
AU - Goyal A.
AU - Shyamasundar R.
AU - Jetley R.
AU - Mohan D.
AU - Ramaswamy S.
PY - 2019
SP - 226
EP - 237
DO - 10.5220/0007842502260237