Software Test Automation Maturity: A Survey of the State of the Practice

Yuqing Wang, Mika Mäntylä, Serge Demeyer, Kristian Wiklund, Sigrid Eldh, Tatu Kairi

2020

Abstract

The software industry has seen an increasing interest in test automation. In this paper, we present a test automation maturity survey serving as a self-assessment for practitioners. Based on responses of 151 practitioners coming from above 101 organizations in 25 countries, we make observations regarding the state of the practice of test automation maturity: a) The level of test automation maturity in different organizations is differentiated by the practices they adopt; b) Practitioner reported the quite diverse situation with respect to different practices, e.g., 85% practitioners agreed that their test teams have enough test automation expertise and skills, while 47% of practitioners admitted that there is lack of guidelines on designing and executing automated tests; c) Some practices are strongly correlated and/or closely clustered; d) The percentage of automated test cases and the use of Agile and/or DevOps development models are good indicators for a higher test automation maturity level; (e) The roles of practitioners may affect response variation, e.g., QA engineers give the most optimistic answers, consultants give the most pessimistic answers. Our results give an insight into present test automation processes and practices and indicate chances for further improvement in the present industry.

Paper Citation

in Harvard Style

Wang Y., Mäntylä M., Demeyer S., Wiklund K., Eldh S. and Kairi T. (2020). Software Test Automation Maturity: A Survey of the State of the Practice.In Proceedings of the 15th International Conference on Software Technologies - Volume 1: ICSOFT, ISBN 978-989-758-443-5, pages 27-38. DOI: 10.5220/0009766800270038

in Bibtex Style

@conference{icsoft20,
author={Yuqing Wang and Mika Mäntylä and Serge Demeyer and Kristian Wiklund and Sigrid Eldh and Tatu Kairi},
title={Software Test Automation Maturity: A Survey of the State of the Practice},
booktitle={Proceedings of the 15th International Conference on Software Technologies - Volume 1: ICSOFT,},
year={2020},
pages={27-38},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009766800270038},
isbn={978-989-758-443-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Software Technologies - Volume 1: ICSOFT,
TI - Software Test Automation Maturity: A Survey of the State of the Practice
SN - 978-989-758-443-5
AU - Wang Y.
AU - Mäntylä M.
AU - Demeyer S.
AU - Wiklund K.
AU - Eldh S.
AU - Kairi T.
PY - 2020
SP - 27
EP - 38
DO - 10.5220/0009766800270038