Manual Testing
Mission 🙏
To help the production team produce the highest quality work efficiently and reliably.
Definition of Success 📈
- We discover at most one critical bug in production per project per year
- Our sites satisfy our stated site standards unless otherwise documented and agreed internally and with the client
Key Responsibilities 💪
- Manual testing for completed websites and new features across various browsers and device profiles
- Implementation & maintenance of automated testing tools
- Reviewing wireframes and visual designs to detect quality issues early
- Assisting devs and designers with creation and maintenance of site documentation
Key Skills 🤹🏽
| Skill | Roles | Level 1 | Level 2 | Level 3 | Level 4 | Level 5 |
|---|---|---|---|---|---|---|
Manual Testing | ||||||
Automated Testing | QA Engineer | Is actively learning about using automated tools to test sites. | Understands the different types of automated testing available. Can monitor and adjust existing automated testing setups. | Can implement at least one strategy for implementing automated acceptance/integration testing | Can implement multiple strategies for writing acceptance tests and connecting them to our continuous integration tools requiring minimal help from DevOps. | Is an expert in automated testing technology. Understands multiple platforms and approaches and when they are appropriate. Can integrate automated testing tools with a CI/CD pipeline without help. |
Accessibility Knowledge | QA Engineer | Knows the basic principles of web accessibility and what makes for an accessible website. Can test for keyboard accessibility. | Knows how to use at least one screen reader to test websites. Knows all the common accessibility antipatterns (keyboard traps, labels in images, etc) and can identify them on sites. Can use automated tools like AXE to analyze websites and report back to developers on issues. Can check all WCAG AA 2.1 rules which do not involve looking at actual code. | Can check the full WCAG AA 2.1 checklist including reviewing code for invisible or structural problems. Understands common solutions to accessibility issues. | Understands the qualitative experience of disabled users. Has extensively used a screen reader and knows how to use it the way a real-world user would. | Is an expert on web accessibility, knowing the WCAG criteria intimately but also understanding the qualitative experience of disabled users. |
Working with Developers/Designers | QA Engineer | Can articulate issues to developers accurately | Works efficiently with developers to help them replicate bugs. | Can contribute to conversations around Cantilever dev strategies based on findings in prior QA processes. | Can pair with devs to break down issues by looking at the code. | Works with our dev team to modify their practices in response to recurring problems noticed within our source code |