CASE STUDY

How a global healthcare company improved testing cycle time by 40x of their complex, data-intensive Salesforce CPQ implementation program

About
the client

The client is a global top 10 healthcare company in the world. Focused on developing new approaches in the areas of radiology, cardiology, oncology, respiratory, and other critical areas, the company’s product portfolio has more than 450 innovative products and services, including medical devices like CT scanners, MRI scanners, ultrasound equipment, and more.

Building and maintaining a framework makes things overly complex. It is ever evolving, unyielding, and unfinished. This demands increasingly higher technical competencies to solve its own problems. This shifts focus away from quality to making automation work.
Qualitia breaks down technology barriers. It makes test automation extremely intuitive and 100% scriptless, giving testers freedom to be the best they can be.

Situation

The client uses the Salesforce platform to configure pricing rules and legal compliance across their massive product range and geographies. The complexity involved in the configuration process made it challenging for them to create combinable and upgradable product bundles. They decided to integrate their Salesforce with Apttus CPQ with the intention of:

Ensuring dependency and accuracy of complex products bundles

Generating accurate quotes across regions with varying discounts applied

Improving client’s buying experience and accelerating the sales cycle

But the integration of the sophisticated features of Apttus with Salesforce’s sales cloud brought about tremendous testing responsibility to ensure that all product bundles were working as expected and all calculations involved were precise.

With the new Apttus integration, this leading healthcare company wanted a Salesforce testing solution that could:

Ensure data consistencies were maintained across environments

Generate accurate quotes across all modalities and geographies

Reduce the time to test each release

But their existing testing cycle was slow, partially automated, and high touch.

Although the client’s core products had evolved over a number of years, their testing environment was struggling to keep pace. Even with a phenomenal investment in business users, maintaining tests and creating new ones for tens of thousands of products was time-consuming, tedious, error-prone, and expensive.

Limitations of a homegrown traditional test automation framework

This global leader realized that taking a manual approach to testing was too time-consuming, and the use of traditional automation solutions using opensource tools was creating challenges around test brittleness and maintenance effort.

The existing testing approach didn’t allow them to test 100%.

Challenges

Data Configuration and Optimization

For Salesforce Apttus CPQ to work optimally, it needed access to accurate, up-to-date, and complete information. This meant the product team had to provide all the end-product data, including technical specifications, features, components, and parts. Similarly, their finance team had to send pricing options, discounts, restrictions, or other price lists for each product and its variants across geographies.

Here, there were two major challenges: Firstly, configuring a massive quantum of data on the Salesforce Apttus CPQ was a resource-intensive process. Secondly, manually testing those large volumes of data involving 1500 actions per model posed a huge challenge.

They needed a data-driven testing approach with a robust data management feature.

Salesforce Integrations

Salesforce allowed integrations with a wide range of applications. Although these integrations helped them map end-to-end business processes and custom configurations, testing them was painstakingly laborious.

They needed an easy-to-use test automation solution that accommodates the complexity with ease.

Test Automation Complexity of Salesforce

Salesforce is a technologically powerful platform having sophisticated architecture involving dynamic frames, shadow DOM, database-driven tables, three seasonal releases, and classic and lightning versions. This made Salesforce test automation particularly difficult with traditional automation methods such as Selenium.

Their ultimate need was to have the most reliable test automation solution for its Salesforce platform.

Qualitia was chosen after a steep evaluation.

The client could easily configure end to end testing of 100 models in a quarter to smoke test them before every release. The number of models eventually increased to 2000 across 6 different environments in just additional 4 quarters.

Solution

Qualitia outperformed the traditional test automation frameworks with the help of some key functionalities:

Data Management
When it comes to test automation, Qualitia can visualize the input data much better than most automation tools.

The data management feature of Qualitia allowed the client team to configure and manage data with a single click. The tool made it easy to import data from multiple data sources to test various scenarios or processes within Salesforce. Qualitia verified data integrity to make sure data was consistent within Salesforce Apttus CPQ across dashboards and reports.
Data Management

When it comes to test automation, Qualitia can visualize the input data much better than most automation tools.

The data management feature of Qualitia allowed the client team to configure and manage data with a single click. The tool made it easy to import data from multiple data sources to test various scenarios or processes within Salesforce. Qualitia verified data integrity to make sure data was consistent within Salesforce Apttus CPQ across dashboards and reports.

Built-in Automation Design Functionality

Qualitia allows testers to divide complex end-to-end workflows into reusable business functions to create intuitive scripts.

Qualitia’s reusability functionality and ability to create complex orchestrations by stringing together multiple tests across multiple browsers and platforms ensured lower maintenance efforts and faster test executions. Qualitia also ran parallel executions that helped reduce the time to execute multiple test cases.

Built-in Automation Design Functionality

Qualitia allows testers to divide complex end-to-end workflows into reusable business functions to create intuitive scripts.

Qualitia’s reusability functionality and ability to create complex orchestrations by stringing together multiple tests across multiple browsers and platforms ensured lower maintenance efforts and faster test executions. Qualitia also ran parallel executions that helped reduce the time to execute multiple test cases.

End-to-end Testing

Qualitia tests are extensible to fit countless integration scenarios.

This allowed business users to create automated end-to-end test cases that could cut through Salesforce’s complexity, integrations, and customizations, together with Seasonal Releases and migrations to Lightning without needing to code.

End-to-end Testing

Qualitia tests are extensible to fit countless integration scenarios.

This allowed business users to create automated end-to-end test cases that could cut through Salesforce’s complexity, integrations, and customizations, together with Seasonal Releases and migrations to Lightning without needing to code.

Easy Test Automation

Qualitia is truly a scriptless test automation solution for Salesforce!

Qualitia’s intuitive intelligent test recorder made it super-easy for anyone to create automated tests.

Easy Test Automation

Easy Test Automation Qualitia is truly a scriptless test automation solution for Salesforce!

Qualitia’s intuitive intelligent test recorder made it super-easy for anyone to create automated tests.

Intelligent Reports

With Qualitia, you can dig deeper and get a detailed analysis of each success and failure.

With the help of screenshots and text logs, Qualitia allowed the QA teams to analyze the results deeper. Moreover, its open architecture enabled them to extract data from the database and use it in the visualization format they preferred.

Intelligent Reports

With Qualitia, you can dig deeper and get a detailed analysis of each success and failure.

With the help of screenshots and text logs, Qualitia allowed the QA teams to analyze the results deeper. Moreover, its open architecture enabled them to extract data from the database and use it in the visualization format they preferred.

Biggest test automation wins

40x improvement in execution time

Qualitia has helped slash test execution time from 4 models per hour with manual testing, to 160 models per hour with automation!

End-to-end testing of the most complex workflows is now being done with 100% accuracy and reliability in each release cycle.

75% reduction in defects

With a rapid increase in test coverage, testing is now happening in early stages of development cycles.

Automation execution is now done continuously across multiple environments to ensure no major or critical defect leaks into UAT.

Only 5% of incremental efforts to accommodate changes in each release

A superior design led to minimal maintenance effort. Automation is now always ready before the release.

Talk to Us!

Take the control back in test automation. Win it easy with Qualitia.