Testing Your eRecruiting Products for Accessibility

What’s the key to understanding how accessible your products are? A good testing process.

As an employer, it’s the job of leadership to understand how accessible your tools are—including your eRecruiting tools such as online job applications, recruiting websites, talent management systems, digital interview technologies, and more.

The key is a good testing process

Such a process, including accurate and comprehensive reporting on testing results, can improve communication with job seekers, employees, customers, and other end users about your company’s commitment to accessibility and foster a culture of continuous improvement.

Find Out Where Testing “Lives” in Your Organization — Accessibility testing belongs wherever your organization already performs product testing. The two most common “homes” are with usability testing and compliance testing. Either type of testing group can perform accessibility testing, although you may need to invest in equipment (such as assistive technology) and staff training.

  • Usability testing often involves real people going through a list of tasks with the product in order to assess how well the design matches human performance behaviors. Thus, accessibility testing fits right in, because people with disabilities are among any product’s potential users.
  • Compliance testing, on the other hand, involves lab bench-type testing to meet the requirements of a specific law or regulation, and may never involve actual testers.

Decide Which Standards Apply — Depending on the product you are testing, you need to determine if there are federal and/or state laws that apply and then, based on that information, decide which technical standards you need to meet. For example, a videoconferencing product may fall under the 21st Century Communication and Video Accessibility Act (CVAA) and its guidelines. Many websites are subject to the nondiscrimination provisions of the ADA and Section 503 of the Rehabilitation Act, which generally means you should use the World Wide Web Consortium’s Web Content Accessibility Guidelines (WCAG 2.1).

  • PEAT TIP: If you choose the WCAG standard, we recommend using the WCAG-EM Report Tool to generate a customized, structured report to help you outline and organize the testing process.

Do Comprehensive Testing — There is general consensus that while automated testing is a good start and can find a majority of accessibility issues, manual testing is essential. For example, an automated test can tell you whether all images have alternative text, but only a manual test can indicate whether an image actually requires a text alternative (it might just be used for formatting a screen, for example) or whether the alternative text makes sense, given the context of the image. Given that many work-related websites are designed to allow users to accomplish a goal and not just read text or watch videos, a purely guideline-driven testing approach will often be weaker than one based on a list of tasks users actually have to perform.

Procedurally, it makes sense to perform all automated tests and then have a skilled analyst go through the results to confirm the errors and perform the necessary manual tests. It is important to note that exact testing protocols are still more art than science and sometimes viewed as proprietary. However, as the domain of accessible information and communications technology (ICT) matures, there is more consensus and sharing.

  • PEAT TIP: Check out the automated tools available for testing software and web content (note that the same cautions mentioned above apply):

As an employer, it’s the job of leadership to understand how accessible your tools are—including your eRecruiting tools such as online job applications, recruiting websites, talent management systems, digital interview technologies, and more. The key is a good testing process.

Incorporate Scenario-Based Testing — Effective accessibility testing can also be performed by creating persona-based test cases using a scenario model. In these cases, you gather relevant information about who your primary users are and add the possibility of differing abilities to the dimension of that persona. For instance, if you are developing a job application system, including tests like searching for job listings, uploading a resume, and completing the application can all be scenarios to include in the testing phase.

Taking that idea to the next level, creating personas allows your coverage to include sometimes overlooked populations. For example, someone who uses a screen-reading application, either built into certain devices or installed separately, could be one persona. Then, you would run all the scenarios listed above using available screen-reading applications. Other possible personas could include people who use hearing aids, persons with limited dexterity, and others who may require large or high-contrast fonts and displays. The more your testing can mimic potential users, including users with disabilities, the better your final product will be. Thorough testing early on could potentially reduce time-to-market for subsequent updated or new releases as you establish a mechanism for testing, reporting, and addressing the findings that this type of testing methodology can reveal.

Check Compatibility and Interoperability with Assistive Technology Devices (AT) — If possible, test with all the AT devices commonly used by the people who will potentially use your product to ensure interoperability. Particularly in the case of screen readers, your testing should be comprehensive. Use the same task list you use for users without disabilities, and thoroughly exercise the interface, using several different methods to accomplish each task. Make sure you test the most basic functions, not just the more advanced or complex features.

Remember Documentation and Support — While the product’s own accessibility is the most important thing to test, everything the user encounters should be accessible as well. So be sure to test the user manuals and online help features. If you have live support for the product, provide appropriate details to your help desk personnel so they can answer common questions and understand when to forward more complex situations. You can also go even further with accessibility testing. For example, several companies test their ICT product packaging, which can often be difficult to open for people with dexterity limitations.

Report Test Results — Test results should be reported internally so they can be shared with the rest of the product team and any others. That way, lessons learned can be incorporated into current and future product development. They should also be reported externally as a way to keep customers informed and convey your company’s ongoing commitment to accessibility. External reporting can take place in a number of ways. One common method is a Voluntary Product Accessibility Template (VPAT), which is a tool used to report a product’s compliance with Section 508 accessibility guidelines. It is a table that shows all of Section 508’s provisions, and whether and how well the product addresses them. Although this tool was developed to assist federal contracting officials in assessing accessibility of products from potential vendors, it can be used by any technology providers to allow all potential customers to learn about the accessibility of their products. However, customers may need much more detail than a VPAT typically provides. For example, if the customer has employees who use certain AT products, it may be necessary to reveal detailed testing results, or even perform follow-up compatibility testing.

Plan for Any Needed Fixes — Once testing is complete, you should create a plan for repairing or remediating accessibility errors. Such plans will vary based on the nature of the product and the barriers or issues you’ve identified. Not everything can be fixed at once. But it’s important to keep track of the list and rank them by importance. Doing so is essential to keeping accessibility as a priority and developing products that are usable by the widest number of people possible—a very smart business strategy.

Learn More:

Download PDF Version