Validating the effectiveness of EvalAccess when deploying WCAG 2.0 tests

Submitted by mlb78 on Fri, 09/16/2016 - 17:23
TitleValidating the effectiveness of EvalAccess when deploying WCAG 2.0 tests
Publication TypeJournal Article
Year of Publication2011
AuthorsAizpurua, Amaia, Arrue, Myriam, Vigo, Markel, and Abascal, Julio
JournalUniversal Access in the Information Society
Volume10
Issue4
Pagination425-441
ISSN Number1615-5289
KeywordsAutomated evaluation, Web accessibility guidelines, WGAC 1.0, WGAC 2.0
AbstractWhile automatic tools are not intended to replace human judgment, they are crucial in order to develop accessible websites. The release of WCAG 2.0 has caused great expectation, as it is supposed to be precisely testable with automated review tools. Therefore, more effective tools could be developed. However, so far few tools applying WCAG 2.0 have been developed. This paper presents an evaluation framework which has been updated in order to evaluate the new tests. In addition, it describes a validation process carried out in order to verify the effectiveness of the new version of the evaluation tool. The effectiveness is validated by conducting a quantitative and qualitative analysis of the results obtained by applying both versions of the tool (the one implementing WCAG 1.0 and the one implementing WCAG 2.0) to a set of selected web pages, as well as by manual evaluation of an expert for detecting the possible false positives and false negatives produced by each tool.
NotesThis study aimed to compare the old WCAG 1.0 with the newly released WCAG 2.0. Both guidelines were applied to a set of websites and evaluated both by automoted evaluation tools and by manually evaluation. Both quantitative and qualitative analysis were conducted. Results showed that although the second version of WCAG performed better, it also had a higher rate of wrongly detected issues.
DOI10.1007/s10209-011-0226-z