CASE STUDY
How a global healthcare company improved testing cycle time by 40x of their complex, data-intensive Salesforce CPQ implementation program
About
the client
The client is a global top 10 healthcare company in the world. Focused on developing new approaches in the areas of radiology, cardiology, oncology, respiratory, and other critical areas, the company’s product portfolio has more than 450 innovative products and services, including medical devices like CT scanners, MRI scanners, ultrasound equipment, and more.
Situation
The client uses the Salesforce platform to configure pricing rules and legal compliance across their massive product range and geographies. The complexity involved in the configuration process made it challenging for them to create combinable and upgradable product bundles. They decided to integrate their Salesforce with Apttus CPQ with the intention of:
Ensuring dependency and accuracy of complex products bundles
Generating accurate quotes across regions with varying discounts applied
Improving client’s buying experience and accelerating the sales cycle
But the integration of the sophisticated features of Apttus with Salesforce’s sales cloud brought about tremendous testing responsibility to ensure that all product bundles were working as expected and all calculations involved were precise.
With the new Apttus integration, this leading healthcare company wanted a Salesforce testing solution that could:
Ensure data consistencies were maintained across environments
Generate accurate quotes across all modalities and geographies
Reduce the time to test each release
But their existing testing cycle was slow, partially automated, and high touch.
Although the client’s core products had evolved over a number of years, their testing environment was struggling to keep pace. Even with a phenomenal investment in business users, maintaining tests and creating new ones for tens of thousands of products was time-consuming, tedious, error-prone, and expensive.
Limitations of a homegrown traditional test automation framework
This global leader realized that taking a manual approach to testing was too time-consuming, and the use of traditional automation solutions using opensource tools was creating challenges around test brittleness and maintenance effort.
The existing testing approach didn’t allow them to test 100%.
Challenges
Data Configuration and Optimization
For Salesforce Apttus CPQ to work optimally, it needed access to accurate, up-to-date, and complete information. This meant the product team had to provide all the end-product data, including technical specifications, features, components, and parts. Similarly, their finance team had to send pricing options, discounts, restrictions, or other price lists for each product and its variants across geographies.
Here, there were two major challenges: Firstly, configuring a massive quantum of data on the Salesforce Apttus CPQ was a resource-intensive process. Secondly, manually testing those large volumes of data involving 1500 actions per model posed a huge challenge.
They needed a data-driven testing approach with a robust data management feature.
Salesforce Integrations
Salesforce allowed integrations with a wide range of applications. Although these integrations helped them map end-to-end business processes and custom configurations, testing them was painstakingly laborious.
They needed an easy-to-use test automation solution that accommodates the complexity with ease.
Test Automation Complexity of Salesforce
Salesforce is a technologically powerful platform having sophisticated architecture involving dynamic frames, shadow DOM, database-driven tables, three seasonal releases, and classic and lightning versions. This made Salesforce test automation particularly difficult with traditional automation methods such as Selenium.
Their ultimate need was to have the most reliable test automation solution for its Salesforce platform.
Qualitia was chosen after a steep evaluation.
The client could easily configure end to end testing of 100 models in a quarter to smoke test them before every release. The number of models eventually increased to 2000 across 6 different environments in just additional 4 quarters.
Solution
Qualitia outperformed the traditional test automation frameworks with the help of some key functionalities:
The data management feature of Qualitia allowed the client team to configure and manage data with a single click. The tool made it easy to import data from multiple data sources to test various scenarios or processes within Salesforce. Qualitia verified data integrity to make sure data was consistent within Salesforce Apttus CPQ across dashboards and reports.
When it comes to test automation, Qualitia can visualize the input data much better than most automation tools.
The data management feature of Qualitia allowed the client team to configure and manage data with a single click. The tool made it easy to import data from multiple data sources to test various scenarios or processes within Salesforce. Qualitia verified data integrity to make sure data was consistent within Salesforce Apttus CPQ across dashboards and reports.
Qualitia allows testers to divide complex end-to-end workflows into reusable business functions to create intuitive scripts.
Qualitia’s reusability functionality and ability to create complex orchestrations by stringing together multiple tests across multiple browsers and platforms ensured lower maintenance efforts and faster test executions. Qualitia also ran parallel executions that helped reduce the time to execute multiple test cases.
Qualitia allows testers to divide complex end-to-end workflows into reusable business functions to create intuitive scripts.
Qualitia’s reusability functionality and ability to create complex orchestrations by stringing together multiple tests across multiple browsers and platforms ensured lower maintenance efforts and faster test executions. Qualitia also ran parallel executions that helped reduce the time to execute multiple test cases.
Qualitia tests are extensible to fit countless integration scenarios.
This allowed business users to create automated end-to-end test cases that could cut through Salesforce’s complexity, integrations, and customizations, together with Seasonal Releases and migrations to Lightning without needing to code.
Qualitia tests are extensible to fit countless integration scenarios.
This allowed business users to create automated end-to-end test cases that could cut through Salesforce’s complexity, integrations, and customizations, together with Seasonal Releases and migrations to Lightning without needing to code.
Qualitia is truly a scriptless test automation solution for Salesforce!
Qualitia’s intuitive intelligent test recorder made it super-easy for anyone to create automated tests.
Easy Test Automation Qualitia is truly a scriptless test automation solution for Salesforce!
Qualitia’s intuitive intelligent test recorder made it super-easy for anyone to create automated tests.
With Qualitia, you can dig deeper and get a detailed analysis of each success and failure.
With the help of screenshots and text logs, Qualitia allowed the QA teams to analyze the results deeper. Moreover, its open architecture enabled them to extract data from the database and use it in the visualization format they preferred.
With Qualitia, you can dig deeper and get a detailed analysis of each success and failure.
With the help of screenshots and text logs, Qualitia allowed the QA teams to analyze the results deeper. Moreover, its open architecture enabled them to extract data from the database and use it in the visualization format they preferred.
Biggest test automation wins
40x improvement in execution time
Qualitia has helped slash test execution time from 4 models per hour with manual testing, to 160 models per hour with automation!
End-to-end testing of the most complex workflows is now being done with 100% accuracy and reliability in each release cycle.
75% reduction in defects
With a rapid increase in test coverage, testing is now happening in early stages of development cycles.
Automation execution is now done continuously across multiple environments to ensure no major or critical defect leaks into UAT.
Only 5% of incremental efforts to accommodate changes in each release
A superior design led to minimal maintenance effort. Automation is now always ready before the release.
Read more case studies on Salesforce test automation:
Read more case studies on Salesforce test automation:
How Qualitia helped a global medical device manufacturer break down Salesforce testing barriers.