Evaluating Random Input Generation Strategies for Accessibility Testing

Diogo Santos, Vinicius Durelli, Andre Endo, Marcelo Eler

2021

Abstract

Mobile accessibility testing is the process of checking whether a mobile app can be perceived, understood, and operated by a wide range of users. Accessibility testing tools can support this activity by automatically generating user inputs to navigate through the app under evaluation and run accessibility checks in each new discovered screen. The algorithm that determines which user input will be generated to simulate the user interaction plays a pivotal role in such an approach. In the state of the art approaches, a Uniform Random algorithm is usually employed. In this paper, we compared the results of the default algorithm implemented by a state of the art tool with four different biased random strategies taking into account the number of activities executed, screen states traversed, and accessibility violations revealed. Our results show that the default algorithm had the worst performance while the algorithm biased towards different weights assigned to specific actions and widgets had the best performance.

Paper Citation

in Harvard Style

Santos D., Durelli V., Endo A. and Eler M. (2021). Evaluating Random Input Generation Strategies for Accessibility Testing. In Proceedings of the 23rd International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-509-8, pages 66-75. DOI: 10.5220/0010456100660075

in Bibtex Style

@conference{iceis21,
author={Diogo Santos and Vinicius Durelli and Andre Endo and Marcelo Eler},
title={Evaluating Random Input Generation Strategies for Accessibility Testing},
booktitle={Proceedings of the 23rd International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2021},
pages={66-75},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010456100660075},
isbn={978-989-758-509-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 23rd International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Evaluating Random Input Generation Strategies for Accessibility Testing
SN - 978-989-758-509-8
AU - Santos D.
AU - Durelli V.
AU - Endo A.
AU - Eler M.
PY - 2021
SP - 66
EP - 75
DO - 10.5220/0010456100660075