Test Sets

Test Sets are logical groups of test cases. The purpose of test sets is to define groups of tests that should be executed together within one run. For instance, a smoke test is a group of tests that only check for top-critical capabilities. Whenever any test case from a smoke test fails, there is a critical problem. Executing a smoke test should not take too long. They are executed for instance whenever a developer commits changes to the source code. By comparison, a regression test is a comprehensive test which should provide a detailed overview over the system under test. Execution often takes hours or even days. To define the set of tests to be executed for those purposes, test sets are created. A test case can be assigned to several test sets.

Creating Test Sets

To create a test set:

1. In the Planning section, click Test Sets. The Test Sets page is displayed.
2. Click Create Test Set. The Create Test Set window is displayed.
   
   

   

   
   
3. Fill in the form as follows:
   • Name - Enter a name for the test set.

   • Description - (Optional) Enter a description for the test case.

     In order to add formatted text, you can use Markdown syntax.

   • Labels - Add any number of labels which makes it easy to find test set with joint labels.
4. Click Create. The test set is created and displayed in the Test Sets page.

Assigning Test Cases to a Test Set

To assign test cases to a test set perform the following steps.

1. Open the test set you want to assign test cases to by clicking it.
2. In the Tasks menu, click Assign Test Cases. The Select Test Cases window is displayed.
3. Select the test cases you want to add. You can search for test cases by entering the name, the key, or a label.
   
   

   

   
   
4. Click Assign. The test cases are assigned to the test set and are displayed on the Test Cases tab.
   Tip:

   • Assign test cases to test sets
   • Upload documents

Navigation and Search

To quickly find your test sets, use the search function and the filters. Navigate within the page using and configuring the paginator. Alternatively, you can use the breadcrumb to navigate between the pages.

1. Search - You have two filter tabs to choose from:

   • Browse - to list all test sets.
   • Updated by me (predefined) - to list only the test sets that have been updated by the current user, running the Test Manager instance.
2. Filter - Use the search bar to find test sets by their key, name or labels(requires full search term match).

Linking Orchestrator Test Sets

You can link your test sets from Orchestrator and execute them in Test Manager.

Note:

• You can only link individual test sets that contain automated test cases.
• Test set linking is available for connected Orchestrator instances version 2020.10 or higher.
• Test sets linked from Orchestrator are read-only. This means that you cannot edit the name, description, or version number.

To link test sets from Orchestrator, navigate to Test Sets > Link, select a test set, and then click Link.