Understanding how test results are organized in Test Manager is very important in order to deal with dashboards and reporting.
One fundamental concept in Test Manager is that results need to represent the test how it was designed when it was executed. This needs to hold true even if a test case has been updated or even deleted after it has been executed.
The same applies to test sets. Execution results need to represent the entire set even if case tests have been removed from the set after the initial execution.
In order to achieve this, the execution of a test set is done the following way:
- Test Manager creates a container - a so-called Test Execution - which has the same name as the corresponding Test Set.
- In this Test Execution, it adds an empty test result - a so-called Test Case Log - for each test case from the test set.
- Test Manager then iterates through the Test Case Logs from the Test Execution and executes all the corresponding test cases. The results are set on the particular Test Case Logs along with all the log information.
The chart below illustrates the process of executing a test set in Test Manager.
As a consequence, after a test set has been executed, any changes to the test set or its associated test cases do not affect the results from previous executions. Even when a test set is deleted, all the Test Executions remain unchanged.
To view test executions, select Test Results from the project navigation. You will see a list of Test Executions each representing the execution of a test set.
Updated about a year ago