- Getting Started with Test Suite
- Studio
- Orchestrator
- Testing robots
- Test Manager
Test Suite User Guide
Quickstart guide
This quickstart guide provides you with a comprehensive introduction to Test Manager, empowering you to efficiently manage and execute test cases for your Studio projects. Test Manager offers a robust test management solution with support for multiple test frameworks, integration with various source control systems, and advanced reporting capabilities.
- Create a project in Test Manager, or import an
existing project.
Visit Import project to learn how to import testing projects from other tools.
- Create the requirements for your test cases.
- Create test cases either in Studio, or directly in Test Manager.
- Create test sets and assign test cases to them.
- Execute the tests.
- Analyze the test results.
Test Manager provides a set of features for creating, managing, and executing test cases for your projects. This guide walks you through the process of creating test cases, assigning automations to them, adding manual steps, and linking requirements.
Build your testing portfolio, and create test cases within Test Manager:
- Open your project in Test Manager and navigate to the Test Cases section.
- Select Create Test Case and configure the test case details such as name, version, description, and labels.
- Select Confirm, and the test case will be displayed under Test Cases.
To establish traceability between test cases and requirements, you can assign test cases to requirements in Test Manager.
- Open the desired test case.
- Go to Tasks, and select Assign to Requirement.
- Choose the requirements you want to link the test case to.
- Select Assign to save the changes.
Test cases in Test Manager can include both manual steps and a Studio automation. The automations are created in Studio as test cases, using the available activities. You need to assign Studio automations to test cases from Test Manager, to use automated executions.
To link an automation created in Studio to a test case in Test Manager:
- Integrate Studio with Test Manger, and configure the Test Manager Settings from the Studio Design ribbon.
- Select Link to Test Manager.
- Configure the test case information, such as:
- Project: Select your project. If you did not set a default project for Test Manager, see Integrating with Studio.
- Test: Select a test case from the dropdown list.
- Name: Enter a name only if you create a new test case in Test Manager.
-
Requirement: Leave this field blank if you don't want to link the test case to an existing requirement. The name is read-only in Test Manager. Alternatively, you can select a Requirement from the dropdown list if you want to assign the test case to a specific requirement in Test Manager.
In addition to the automation, you can also include manual steps within test cases. These manual steps provide instructions for executing specific actions during the testing process. When you create or edit a test case, you can add manual steps, describe the action, expected behavior, and define clipboard values, so you don't have to manually type into fields.
Visit Manual test cases to learn how to add manual steps to test cases inside Test Manager.
In Test Manager, you have the option to upload relevant documents as attachments to test cases.
Option | Description |
---|---|
Manual upload | Follow the steps below:
|
Attach Document activity | Add the Attach Document activity in your Studio automation. The attachments will appear inside the Attachments tab on the Test Results page after execution. |
- Select More Options for the test case that you want to duplicate, and then Clone.
- Choose if you want to also clone related information, such as documents, labels, or assignments to requirements.
- Select Clone to save your changes.
Test Manager provides a range of actions that can be performed on individual test cases:
- View an overview of a test case when you select its key. This takes you to the Overview page.
- Access the log of the latest result of the test case. Select Open execution log for a test case and you can see details about the latest test execution.
- Delete test cases.
- Unlink automation.
- Clone test cases.
- Open your project in Test Manager, and select Test Sets.
- Select Create Test Set.
- Fill in the information about the test set, such as name, description, if it should display the activity coverage(Enable RPA activity coverage calculation), and labels.
- Select Create to save your changes.
After you create a test set, you need to assign test cases to it. To assign test cases to a test set, open the desired test set, and in the Tasks menu select Assign Test Cases.
- Using Static assignment - manually select the test cases that you
want to link.
- Using Dynamic
assignment - input the label of the test cases that you want to
assign. Whenever an execution is started, all test cases which have at least
one of the selected labels assigned will be added to the execution.
The animated image below shows how to create a test set and assign both static and dynamic test cases to it.
You can link your test sets from Orchestrator and execute them in Test Manager. To achieve this, you first need to create the test set in Orchestrator, and assign only automated test cases to it.
- Open your project in Test Manager.
- Navigate to Test Sets and then Link.
- Select a test set from the list and select Link.
- Select More Options for the test set that you want to duplicate, and select Clone.
- Choose if you want to also clone related information, such as Documents and Labels..
- Select Clone.
In Test Manager, you have the option to execute tests manually or using automations. Manual test executions are performed directly in Test Manager, while automated executions are initiated through Test Manager and carried out via Orchestrator. Before executing test cases, it is necessary to create a test set, which will be used for the execution.
Automated execution refers to test sets created in Test Manager with linked test cases from Studio. Before executing automated tests in Test Manager, make sure you have created the test sets in Orchestrator.
You can execute all test sets using the Execute Automated option. Orchestrator is invoked for test cases linked to Test Manager. To execute test sets linked from Orchestrator, ensure that you create the test sets in Orchestrator.
- Open your project in Test Manager and then navigate to Test Sets.
- Select a test set and click the vertical ellipsis.
- Select Execute Automated.
Manual execution applies to test sets created in Test Manager, including test cases with manual steps. Manual execution can be performed for both Test Manager test sets and linked test sets from Orchestrator.
- Open your project in Test Manager and then navigate to Test Sets.
- Select a test set and click the vertical ellipsis.
- Select Execute Manually. The Manual execution assistant opens in a new window. Make sure your popup blocker allows the window to be opened.
Test Results in Test Manager provide insights about the execution of test sets. Below you have a breakdown of how you can analyze and work with test results.
Open Test Results in Test Manager to view a list of test executions. Each test execution represents the execution of a test set. The executions are sorted based on the finish date, with ongoing and pending executions displayed at the top.
When you select a test execution entry, a detailed view opens. This view displays information such as execution start time, duration, and execution logs. The Results section provides an overview of all individual test results from test cases, named Test Case Logs. This allows you to take actions on individual test results.
- Green - Test cases that passed.
- Red - Test cases that failed.
- Grey - Test cases without definitive results, such as those not yet executed within an ongoing test set.
Result | Description |
---|---|
Execution Log | The execution log contains essential information, including assertions, logs, execution details, affected requirements, and attachments. Select the test case key within the Test Results page to access the execution log. |
Activity Coverage | You can enable activity coverage for automated test executions. This feature provides information on the activities covered during the test execution. |
Defect Management Integration | If you have an external defect management system integrated with Test Manager, you can create defect reports directly from the execution logs. Open a test case log, select Tasks, and then Create Defect. |
Defect Synchronization | Test Manager allows synchronization of execution results with external tools as part of an ALM tool integration. This synchronization ensures that execution details, logs, timestamps, and other relevant information are shared with the integrated tool. |
Create and Unlink Defects | Within the Test Results page, you can create defects by accessing test case logs, selecting Tasks, and selecting Create Defect. Additionally, you have the option to unlink defects from an external tool, which detaches the test execution result from the external tool's entry. |
- Identify manual or automated test results.
- Track the progress of ongoing test executions.
- Open the executed test set to review the details.
- Examine logs and attachments associated with test executions.
- Create defects in your defect management system directly from Test Manager if you have an ALM tool integration.
- Creating requirements
- Cloning requirements
- Creating test cases
- Creating test cases
- Linking test cases to requirements
- Assigning Studio automation to test cases
- Adding manual steps to test cases
- Uploading documents
- Cloning test cases
- Managing test cases
- Creating test sets
- Creating test sets
- Assigning test cases to test sets
- Linking Orchestrator test sets
- Cloning test sets
- Related articles
- Executing tests
- Automated execution
- Executing tests using automations
- Manual execution
- Manually executing tests
- Related articles
- Analyzing results
- Accessing test results
- Execution details
- Understanding test execution status
- Exploring test results
- Working with test results
- Related articles