Debugging Flaky Tests on Web Applications

Jesus Morán, Cristian Augusto, Antonia Bertolino, Claudio de la Riva, Javier Tuya

2019

Abstract

Testing web applications is a challenging practice because it involves managing asynchronous requests between clients and servers, the integration of heterogeneous technologies, and concurrent accesses to the resources. Therefore, rerunning the test cases of these applications under the same conditions is difficult as one test case can be executed in many different ways according to several environmental factors like memory, screen size or network. Moreover, some of these test cases could be flaky, i.e., due to environmental factors the test outcome can vary even though the application did not change. Understanding which factors are the root cause of flakiness is very important for web developers to both prevent and fix flakiness. This paper introduces a technique to locate the root causes of flakiness based on a characterization of the different environmental factors that are not controlled during the testing of web applications. The root cause of flakiness is located by a spectrum-based localization technique that analyses the execution of the same flaky test under different environmental factors that can trigger the flakiness. The technique is illustrated on an educational web platform named FullTeaching.

Paper Citation

in Harvard Style

Morán J., Augusto C., Bertolino A., de la Riva C. and Tuya J. (2019). Debugging Flaky Tests on Web Applications.In Proceedings of the 15th International Conference on Web Information Systems and Technologies - Volume 1: APMDWE, ISBN 978-989-758-386-5, pages 454-461. DOI: 10.5220/0008559004540461

in Bibtex Style

@conference{apmdwe19,
author={Jesus Morán and Cristian Augusto and Antonia Bertolino and Claudio de la Riva and Javier Tuya},
title={Debugging Flaky Tests on Web Applications},
booktitle={Proceedings of the 15th International Conference on Web Information Systems and Technologies - Volume 1: APMDWE,},
year={2019},
pages={454-461},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008559004540461},
isbn={978-989-758-386-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Web Information Systems and Technologies - Volume 1: APMDWE,
TI - Debugging Flaky Tests on Web Applications
SN - 978-989-758-386-5
AU - Morán J.
AU - Augusto C.
AU - Bertolino A.
AU - de la Riva C.
AU - Tuya J.
PY - 2019
SP - 454
EP - 461
DO - 10.5220/0008559004540461