Comparison of Manual Evaluation Methods for Assessing the Accessibility of Websites based on EN 301 549

Gisela Kollotzek, Gottfried Zimmermann, Tobias Ableitner, Anne-Marie Nebe

2021

Abstract

The relevance of information technology has increased significantly over the last couple of years and therefore it is important to provide for universal access to it. Accessibility of public sector websites has become legally binding through Directive (EU) 2016/2102 for EU member states. Automatic accessibility evaluation methods can only provide a superficial impression of the accessibility status. Only manual evaluation methods can facilitate a comprehensive accessibility check. So far, there is no systematic comparison of existing manual evaluation methods available that is based on real data. In this paper, we define a generic catalog of 22 criteria for assessing the quality of accessibility evaluation methods and specify individual weights for the criteria. We then compare two representatives of manual evaluation methods: BIK BITV-Test, as a representative of conformance-based methods; and BITV-Audit, as a representative of empiric-based methods. We analyze similarities and differences between these two methods, and identify weaknesses and strengths. Our results show an advantage of BITV-Audit over BIK BITV-Test, but other weightings could yield different results.

Paper Citation

in Harvard Style

Kollotzek G., Zimmermann G., Ableitner T. and Nebe A. (2021). Comparison of Manual Evaluation Methods for Assessing the Accessibility of Websites based on EN 301 549. In Proceedings of the 5th International Conference on Computer-Human Interaction Research and Applications - Volume 1: CHIRA, ISBN 978-989-758-538-8, pages 24-35. DOI: 10.5220/0010647000003060

in Bibtex Style

@conference{chira21,
author={Gisela Kollotzek and Gottfried Zimmermann and Tobias Ableitner and Anne-Marie Nebe},
title={Comparison of Manual Evaluation Methods for Assessing the Accessibility of Websites based on EN 301 549},
booktitle={Proceedings of the 5th International Conference on Computer-Human Interaction Research and Applications - Volume 1: CHIRA,},
year={2021},
pages={24-35},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010647000003060},
isbn={978-989-758-538-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 5th International Conference on Computer-Human Interaction Research and Applications - Volume 1: CHIRA,
TI - Comparison of Manual Evaluation Methods for Assessing the Accessibility of Websites based on EN 301 549
SN - 978-989-758-538-8
AU - Kollotzek G.
AU - Zimmermann G.
AU - Ableitner T.
AU - Nebe A.
PY - 2021
SP - 24
EP - 35
DO - 10.5220/0010647000003060