TY - JOUR
KW - Web accessibility guidelines
KW - Automated evaluation
KW - WGAC 1.0
KW - WGAC 2.0
AU - Amaia Aizpurua
AU - Myriam Arrue
AU - Markel Vigo
AU - Julio Abascal
AB - While automatic tools are not intended to replace human judgment, they are crucial in order to develop accessible websites. The release of WCAG 2.0 has caused great expectation, as it is supposed to be precisely testable with automated review tools. Therefore, more effective tools could be developed. However, so far few tools applying WCAG 2.0 have been developed. This paper presents an evaluation framework which has been updated in order to evaluate the new tests. In addition, it describes a validation process carried out in order to verify the effectiveness of the new version of the evaluation tool. The effectiveness is validated by conducting a quantitative and qualitative analysis of the results obtained by applying both versions of the tool (the one implementing WCAG 1.0 and the one implementing WCAG 2.0) to a set of selected web pages, as well as by manual evaluation of an expert for detecting the possible false positives and false negatives produced by each tool.
BT - Universal Access in the Information Society
DO - 10.1007/s10209-011-0226-z
IS - 4
LA - eng
N1 - This study aimed to compare the old WCAG 1.0 with the newly released WCAG 2.0. Both guidelines were applied to a set of websites and evaluated both by automoted evaluation tools and by manually evaluation. Both quantitative and qualitative analysis were conducted. Results showed that although the second version of WCAG performed better, it also had a higher rate of wrongly detected issues.
N2 - While automatic tools are not intended to replace human judgment, they are crucial in order to develop accessible websites. The release of WCAG 2.0 has caused great expectation, as it is supposed to be precisely testable with automated review tools. Therefore, more effective tools could be developed. However, so far few tools applying WCAG 2.0 have been developed. This paper presents an evaluation framework which has been updated in order to evaluate the new tests. In addition, it describes a validation process carried out in order to verify the effectiveness of the new version of the evaluation tool. The effectiveness is validated by conducting a quantitative and qualitative analysis of the results obtained by applying both versions of the tool (the one implementing WCAG 1.0 and the one implementing WCAG 2.0) to a set of selected web pages, as well as by manual evaluation of an expert for detecting the possible false positives and false negatives produced by each tool.
PY - 2011
SP - 425
EP - 441
T2 - Universal Access in the Information Society
TI - Validating the effectiveness of EvalAccess when deploying WCAG 2.0 tests
VL - 10
SN - 1615-5289
ER -