You can use test sets to aggregate multiple test scenarios together and execute them as a group. The results of the associated test scenarios are displayed in the outcome and you can drill down to the individual test scenarios and the test claims in those scenarios.
Test sets display the success rate of current and previous executions for comparison and analysis.
To view the list of test sets or create a new one, from the left panel, click Test suite>Test sets. The Test sets list opens and displays all the test sets in the system, their description, the number of associated scenarios and the date of the most recent execution.Creating a test set
To create a test set, select Add test set from the Test sets list.
The Create test set tab opens.
Enter a Name for searching and filtering and a Description with detailed information about the goal or business case the test set supports.
In the Test scenario name field, use the down arrow or begin typing the name of the first test scenario you wish to include. Once you have located it, click Add test scenario. The test scenario is added to the list. Continue to add test scenarios until you have added all the test scenarios that you want to execute in the test set. The last claim in the list is used to validate the scenario against the expected results and claim status you will define.
Once you have finished selecting the scenarios, click Create.Executing a test set
To execute a test set, in the test set review screen, click Execute test set.
Executing the test set executes all the scenarios included in the test set. It may take a few seconds or minutes to execute depending upon the number of scenarios selected.
Once the execution completes, the metadata associated with the test set, the start and end date of the execution, and the scenario success rate are displayed.
The Test scenario section lets you open each scenario included in the test set to view the details of the execution; you can expand each scenario and drill down to see the expected and actual values along with the pass or fail status of each.
The Execution history section shows each execution of the test set and provides the ability to drilldown into the included scenarios for analysis and comparison.
On the top right of the screen, you can select Execute again to run your test set as many times as desired.Editing a test set
You can edit a test set by selecting Edit on the top right. The test set will open in edit mode, allowing you to update any of the fields. When your editing is complete, click Submit to save the changes. You may also Cancel your changes if desired.
Previous topic Test scenarios Next topic External vendor integrations