- Getting started
- Project management
- Working with Change Impact Analysis
- Create test cases
- Assigning test cases to requirements
- Cloning test cases
- Exporting test cases
- Linking test cases in Studio to Test Manager
- Delete test cases
- Enabling governance at project level
- Disabling governance at project level
- Enabling governance at test-case level
- Disabling governance at test-case level
- Enabling or disabling governance in bulk for test cases
- Enforcing signing order for governed test cases
- Managing approvers for governed test cases
- Managing governed test cases in the In Work state
- Managing governed test cases in the In Review state
- Managing governed objects in the Signed state
- Managing comments for governed test cases
- Viewing governance information for test case logs
- Managing approvers for governed test case logs
- Managing governed test case logs in the In Work state
- Managing governed test case logs in the In Review state
- Managing governed test case logs in the Signed state
- Managing comments for governed test case logs
- Enabling governance at test case log level
- Disabling governance at test case log level
- Viewing and searching test cases
- Project operations and utilities
- Test Manager settings
- Tenant level settings
- General project settings
- Events
- Subscribing to events
- Subscribing to all events
- Unsubscribing from events
- Unsubscribing from all events
- Unsubscribing from the Notifications settings page
- Viewing notifications
- Filtering notifications
- Viewing email notifications
- Enabling email notifications for SMTP servers
- Viewing only unread notifications
- Marking all notifications as read
- Clearing all notifications
- Deleting notifications
- Customer managed keys encryption
- Audit logs
- ALM tool integration
- ALM tool integration
- Test Manager Connect
- Test Manager - Integration Service connector
- Outbound IP ranges for connectors
- Working with SAP Cloud ALM and Test Manager
- Step 1: Integrating SAP Cloud ALM with Test Manager
- Step 2: Creating automated test cases in SAP Cloud ALM
- Step 3: Creating automated test cases in Test Manager
- Step 4: Synchronizing test cases from Test Manager to SAP Cloud ALM
- Step 5: Assigning test automations to test cases
- Step 6: Executing test cases
- SAP test automation best practices
- Troubleshooting the Jira integration
- API integration
- Coding Agents for Testing
- Troubleshooting
Test results
Test results in Test Manager, including the lifecycle of test executions, case log population, and result persistence after test set changes.
Test results are the outcome of executing test sets in Test Manager. Each execution holds a test case log for every test case in the executed test set.
Process overview
When you start executing a test set, Test Manager goes through the following process:
- A Test Execution is created in the Execution section of Test Manager. This serves as the container for the test results.
- For every test case within the executed test set, an empty Test Case Log is generated. This log is attached to the Test Execution and will hold its associated test results.
- As the execution continues, the Test Manager fills each Test Case Log with results and related log information.
Note:
Every time a test execution is created, Test Case Logs for all associated test cases from the original test set are added. Furthermore, dynamic assignments are resolved at this stage. This means existing Test Executions remain consistent, regardless of updates or deletions made to the original test set.
The chart below illustrates the process of executing a test set in Test Manager.
As a consequence, after a test set has been executed, any changes to the test set or its associated test cases do not affect the results from previous executions. Even when a test set is deleted, all the test executions remain unchanged.
Label propagation
Labels carry over so you can search and filter your results. A test execution receives the labels of its test set, and a test case log receives the labels of its test case. The following labels carry over:
- User-generated labels
- Autopilot-generated labels
- SAP-related labels
Test result visibility
All user roles can see test results. For details, see Tenant roles and Project roles.
Working with test results
The following topics describe how to analyze and manage test results:
- Analyze test results
- Results from automated tests
- Viewing the live stream
- Viewing recording of test executions
- Overriding test results
- Navigating and searching test results
- Examining test case results
- Playwright test result states
The following topics describe execution logs, activity coverage, and defects: