Meet UserTesting

UserTesting helps over 3,000 enterprise organizations capture and analyze authentic customer feedback. By connecting teams with diverse participants across regions and devices, UserTesting makes it faster and easier to validate assumptions, refine experiences, and build with confidence.

Manual regression slowed every release

Before QA Wolf, UserTesting’s QA team testing load was growing faster than they could automate. They had reliable component and integration tests, but end-to-end coverage was minimal, especially for flows spanning web, Android, and iOS devices or requiring multiple users. 

“Our app has a mix of legacy and modern flows, heavy media capture, and numerous microservice dependencies. Maintaining reliable regression coverage was extremely difficult.”
—Jay Santhakumar, Senior Engineering Manager, Quality 

Limited automation capacity pushed the team to prioritize new changes, leaving large portions of the legacy product dependent on manual testing. As a result, regression testing often took more than two weeks, slowing release cycles.

Their merger with UserZoom expanded the number of features, devices, and dependencies the team had to support, increasing the volume of regression tests that needed to be maintained. 

“The biggest challenge was maintaining the right balance between speed and quality. Our internal teams were committed to automation, but keeping up coverage across multiple fast-moving projects was very demanding.”
—Jay Santhakumar, Senior Engineering Manager, Quality

UserTesting needed a way to automate regression testing for legacy and new flows, stabilize coverage across the merged product, and automate manual mobile and web journeys that were slowing down every release.

High coverage, faster releases, and a stronger QA team

80% automated coverage for web and mobile 

“Since partnering with QA Wolf, the most significant outcome has been achieving close to full coverage of all key user journeys, including mobile flows.”
—Jay Santhakumar, Senior Engineering Manager, Quality

With QA Wolf, UserTesting now maintains 80% automated end-to-end coverage across both legacy and new user journeys on web and mobile. Tests run daily in stable areas and twice daily for parts of the product that change more often, with select workflows also running in production. The team can also point suites to any environment whenever they need fast validation for accessibility updates, security changes, or final checks before release.

“QA Wolf came to our rescue. We now have the confidence to release faster, with critical user journeys fully automated and maintained without adding extra workload to our internal teams.”
—Jay Santhakumar, Senior Engineering Manager, Quality

Hundreds of hours of manual testing time eliminated per release

What once took more than two weeks of manual regression testing is now handled entirely by automated suites. Results arrive on a predictable schedule instead of piling up in the final days before a release, and engineers no longer spend weeks repeating the same manual checks.

“Manual testing time has gone down significantly, which means more time and energy back to our engineers and test developers to focus on new feature delivery and CI/CD improvements.”
—Jay Santhakumar, Senior Engineering Manager, Quality

Outsourced QA that feels in-house

Some team members were initially hesitant about bringing in an external partner. Once the partnership with QA Wolf began, those concerns faded. QA Wolf works directly in UserTesting’s Slack and Jira and delivers automated tests weekly without needing extra management. 

“Even when the flows are complex or span multiple teams, QA Wolf delivers at the same pace. The consistency and speed immediately stood out.”
—Jay Santhakumar, Senior Engineering Manager, Quality

QA Wolf didn’t replace UserTesting’s team. It expanded their capacity by owning regression and cross-platform coverage so internal engineers could focus on higher-value work like integration testing, CI/CD improvements, and feature delivery. 

“Once we saw how QA Wolf’s end-to-end tests fit into our pipelines and caught bugs early, the team realized QA Wolf was expanding our capability, not replacing it.”
—Jay Santhakumar, Senior Engineering Manager, Quality