Evaluating a Success Criterion
When performing a WCAG evaluation (or review or audit), it’s easy to get caught up in the intent versus meaning of a particular Success Criterion. Especially when that SC was written before the interface pattern you’re poking was conceived.
Until, and even when, you have built your own (potentially localized) references for how to apply an SC to whatever situation, it’s best to have a plan for how to interpret the uninterpretable.
Steps
This is my progressive series of steps for getting the W3C’s most current (and soon-to-be-current) position on any SC.
- Read the W3C’s normative text (the “official” requirements) in the WCAG spec.
- Always look at the latest, which is WCAG 2.2 at the time of this writing.
- Make sure you’re at a w3.org site, not some scammy site like wcag.info or a corporate-owned domain playing off the W3C spec like wcag.com.
- Read the W3C Understanding document (the supporting material) for the SC you’re evaluating.
- These often have linked references in the form of…
- W3C Techniques documents collect known failures along with passing and bonus methods.
- Some are out of date or refer to technologies that have been superseded or failed to work as hoped, so be cautious.
- A single Technique document might apply to multiple SCs.
- Look at WCAG GitHub issues.
- Pay attention to dates, linked issues & PRs, embedded meeting minutes, and decisions.
- Look for the closed issues, as those are often decided answers (the issues that aren’t from spambots).
- Look at WCAG GitHub pull requests, even if they never merge.
- Pay attention to dates, linked issues & PRs, and embedded meeting minutes.
- Look for the closed PRs, as the ones that didn’t merge often have good discussions
- Look at GitHub WCAG discussions, few though there are.
- If you find an unanswered one that maps to your question, maybe comment.
- Look at personal blogs of trusted experts, some of whom are often those working on the specs and who give their own insights.
- Be cautious of blogs promoting an agenda or arguing for an SC interpretation without supporting evidence. Pat goes into detail in a 2025 talk and more recent slides.
- This applies to those justifying the bare minimum to pass an SC via loopholes or gaps, in some cases as adversarial or malicious conformance. I have a few posts on that.
No matter what outcome you find, test everything anyway. New releases are constant, regressions common, new support happens, and user expectations shift.
It’s possible you find that a W3C answer to a failure condition creates a worse experience when remediated (orange). At which point, all the research you’ve done will make it easier to justify if you need to break from the W3C position.
Leave a Comment or Response