Test suite reporting
Summary
To run test cases in bulk, group them into a unit test suite and then run the unit test suite. Use the Test Manager to work with unit test suites and view their results.
Suggested Approach
To work with unit test suites, use the Test Manager. To access the Test Manager, select Run > Test Manager.
> Application > Automated Unit Testing.| V6.1 | V5.5 and V5.4 | Purpose |
|---|---|---|
| Automated Unit Testing landing page | Test Manager | Work with test cases and unit tests suites in the current application |
| Automated Unit Tests gadget | – | See all of the test cases and unit test suites defined in the current application |
| Dashboard gadget | Dashboard tab | View results from all unit test suites run in the past five days |
| Reports gadget | Suites tab | View results of a specific unit test suite |
| Schedule gadget | Schedule tab | Create and schedule unit test suites |
You create unit test suites and schedule them to run using the Schedule gadget (tab). Once unit test suites have run, you view their results using the other gadgets (tabs).
Creating and running unit test suites
The Schedule tab of the Test Manager lists each execution of a unit test suite scheduled to run and all unit test suites you have access to. With this tab you can schedule individual unit test suites or create new unit test suites (see Creating unit test suites).
Because unit test suites are run by an agent activity, they cannot be run immediately. To run any unit test suite, you must schedule it to run at a specific future time. Because the agent activity usually checks the queue of scheduled unit test suites every five (5) minutes, it is a good practice to set the schedule for a one-time run more than five minutes in advance of the current time.
To schedule a unit test suite:
- Locate the unit test suite you would like to schedule in the list and click the calendar
icon in the Schedule column. The Schedule Suite window opens.
In V6.1 and V5.5, the window is named Schedule Unit Test Suite, and there is a Pattern section in which you can specify a recurring schedule. For example, you can choose to run the unit test suite daily or weekly.
- In the Schedule window, click the calendar icon.
- In the Calendar window, specify the time and date (month-year-day) for the unit test suite run.
You must actually click on a day in the calendar display to save the date, even if you are choosing the day that is highlighted in the calendar.
- In the Schedule window, click Scheduleto add it to the list of currently scheduled unit test suites.
In V6.1 and V5.5, click the OK button to close the Schedule Unit Test Suite window and add the unit test suite to the list of currently scheduled ones.
The agent activity checks periodically to see what unit test suites are scheduled to run. If any are scheduled to run within the agent's time interval, the agent runs those ones.
Viewing unit test suite results
Dashboard
The Dashboard tab displays a chart with the total number of unit test suites run in the past five days. Below the chart is a list of every unit test suite run in the past five days. By clicking on a unit test suite a detailed list of the unit test suite results displays. This detailed view identifies the rule type, the application the unit test suite applies to, the rule name of the unit test suite, the test case, any differences found, and the execution date of the unit test suite.
Suites
The Suites tab enables you to view the results of a specific unit test suite by selecting it from a drop down list.
After choosing which unit test suite to view, a chart displays the number of expected and unexpected results. By clicking on the expected results column in the chart, a detailed list appears showing all the expected results for that unit test suite. By clicking on the unexpected results column in the chart, a detailed list appears showing all the unexpected results for that unit test suite.
By clicking the Grand Total status line located below the results chart, a detailed list appears showing both the expected and unexpected results of the unit test suite.
On either list, if you click on a test case with unexpected results, the differences found will be listed at the bottom of the Test Manager window. Information about the rule the test case was created from will also display. By clicking on the Open Rule icon, you can view the rule that the test case was based on.
