AI-powered generation

Important:

This feature is currently part of an audit process and is not to be considered part of the FedRAMP Authorization until the review is finalized. See here the full list of features currently under review.

Generating manual test cases for requirement

With the Generate tests feature, you can create manual test cases directly from your requirements using generative AI. The tool that helps you generate test cases is called Autopilot^TM. With the help of Autopilot^TM, this feature creates a list of manual test cases by analyzing various requirement details such as name, description, attachments, custom fields, labels, and documents. You can then create test cases from the initial list or provide specific instructions for generating test cases tailored to your exact needs.

Prerequisites

To use AI-powered test generation for requirement, your Test Manager role must have the following permissions:

Test Case - Create
Requirement - Edit

Let's take the example of testing a feature for submitting loan requests in the UiBank Application. Here's how you would use the tool:

Steps

Open a project, and navigate to Requirements.
Create a requirement called Submit loan request, and type a detailed description about it, highlighting the application flow and acceptance criteria. Check the description that you can use for this example:
Requirement example

This requirement details how people can apply for a loan in the UiBank Banking Application powered by UiPath®.
Application Flow
- The applicant starts the loan application at https://uibank.uipath.com.
- The applicant clicks the 'Product' button in the header menu.
- The applicant clicks the 'Loans' button in the dropdown menu.
- The system redirects to https://uibank.uipath.com/loans.
- The applicant clicks the 'Apply For a Loan' button.
- The system redirects to https://uibank.uipath.com/loans/apply.
- The applicant must fill in the following mandatory fields:
  - Email Address: This field requires an email address in a valid format.
  - Loan Amount: This field accepts only positive integer values.
  - Loan Term: This field provides the options '1', '3', '5', and '10' in years.
  - Yearly income: This field accepts only positive integer values.
  - Age: This field accepts only positive integer values.
- The applicant then clicks the 'Submit Loan Application' button.
- The applicant is notified whether the loan application is approved or rejected on the next page.
Acceptance criteria

For applicants between 18 and 65 years of age and a loan amount less than 100,000 we approve the loan application with:
- 'Congrats! You've been approved for a loan with UiBank!'
For applicants below 18 years of age, we reject the loan application with:
- 'Sorry, at this time you have not been approved for a loan'
For applicants between 18 and 65 years of age and a loan amount of more than 100,000 we reject the loan application with:
- 'Sorry, at this time you have not been approved for a loan'
For applicants not providing all mandatory fields and then clicking 'Submit Loan Application' button:
- No error message will be displayed
- No action will be taken
- The applicant will remain on the same page
Select More Options for this requirement and choose Generate tests. Alternatively, open the requirement, and then choose Generate tests.
The Provide Supporting Documents window opens, prompting you for attachments or other documents necessary for generating test cases. The attachments should be tied to the process of submitting loan requests.
In the Provide Supporting Documents window, select the attachments of the requirement. These are used when generating tests. You can also upload other files yourself.
Select Next and provide additional instructions that Autopilot^TM should use when generating test cases. Choose from a prompt from the Prompt library or type these instructions in the Provide Additional Guidance window.
For instance, you can specify Autopilot^TM the number of test cases that you want to generate. The maximum number of test cases is 50.

You can also specify Autopilot^TM to cover all user steps and acceptance criteria described in the loan request requirement.
Select Generate tests to initiate the process.
When the generation finishes, you will receive a Test Case generation completed notification. Depending on your notification preferences, you can receive the notification both in-app and via email.
Select the Test generation completed notification to review the generated test cases.
1. Expand each test case in the Generate tests panel, and review the generated test cases.
2. If you are satisfied with their content, select Create tests.
  The generated test cases are also linked with the requirement that was used to generate them.
If you are not satisfied with the generated test cases, select Regenerate, and provide additional details about your use case.
1. Attach more relevant documents for Autopilot^TM to use.
2. Click Next and type additional details in the Provide instructions text box.
  The Best Practices section for writing instructions at the end of this page provides guidance for creating effective prompts.
3. After refining the steps, select Regenerate.
4. Click the Test generation completed notification to access the regenerated test cases.
5. Expand each test case and review them.
6. Select the test cases that you are satisfied with, and then select Create tests.

Supported file types

You can only upload the following file extensions, from which Autopilot processes only the text content:

DOCX
XLSX
TXT
PNG
JPG
PDF
BPMN

Note: Autopilot processes only the text content in the files. Images within the files are not processed.

Best practices

Visit Best practices for AI-powered test generation to check a comprehensive list of guidelines and examples to help you write effective instructions.

User access management for AI-powered testing

The AI Trust Layer governance policy allows you to manage the use of AI-powered features within your organization. Although all members have default access to these features, you can use this policy to restrict access as needed. The AI Trust Layer governance policy empowers you to limit a user's access to certain AI-powered features or all of them, at a user, group, or tenant level. Additionally, it gives you the ability to decide which AI products users can access. You can create, modify, and implement this governance policy in AutomationOps.

If you want to deploy an AI Trust Layer governance policy and still use the AI-powered testing capabilities, ensure that, within the policy's Features Toggle, you select Yes for Enabling Test Manager features.

Check the following resources to learn how to create, configure, and deploy a governance policy for your organization.

Accessing latest test generation results

Access your latest generated test cases in the Requirements page.

Go to Latest Results.
Select Generated test cases.

Generating tests for SAP transaction

You can generate test cases for the transactions marked as GAP, using Autopilot^TM.

In the Analyze Transports step from the Impact Analysis, select List view to switch to a table of the impacted transactions.
For the transactions marked as GAP, select Generate.
The Provide Supporting Documents window opens, prompting you for attachments or other documents necessary for generating test cases.

Figure 1. Selecting Generate for Gaps in the Impact Analysis
In the Provide Supporting Documents window, select additional attachments. These are used when generating tests. You can also upload other files yourself.
Figure 2. Selecting an attached document in the Provide supporting documents window
Select Next and provide additional instructions that Autopilot^TM should use when generating test cases. Choose from a prompt from the Prompt library or type these instructions in the Provide Additional Guidance window.
For instance, you can specify Autopilot^TM the number of test cases that you want to generate. The maximum number of test cases is 50.

Figure 3. Entering instructions in the Provide additional guidance window
Select Generate tests to initiate the process.
When the generation finishes, you will receive a Test Case generation completed notification. Depending on your notification preferences, you can receive the notification both in-app and via email.
Select the Test generation completed notification to review the generated test cases.
1. Expand each test case in the Generate tests panel, and review the generated test cases.
2. If you are satisfied with their content, select Create tests.
Figure 4. Expanding a generated test case
If you are not satisfied with the generated test cases, select Regenerate, and provide additional details about your use case.
1. Attach more relevant documents for Autopilot^TM to use.
2. Click Next and type additional details in the Provide instructions text box.
3. After refining the steps, select Regenerate.
4. Click the Test generation completed notification to access the regenerated test cases.
5. Expand each test case and review them.
6. Select the test cases that you are satisfied with, and then select Create tests.

Heatmap

You can generate manual tests using Autopilot for transactions viewed as part of the Heatmap. The generated test cases will have the following labels assigned:

autopilot-generated
TRAN:<transactionCode>

In the Heatmap, select a desired transaction.
Select Generate tests.
The Provide Supporting Documents window opens, prompting you for attachments or other documents necessary for generating test cases.
In the Provide Supporting Documents window, select additional attachments.
These are used when generating tests. You can also upload other files yourself.
Select Next and provide additional instructions that Autopilot^TM should use when generating test cases. Choose from a prompt from the Prompt library or type these instructions in the Provide Additional Guidance window.
For instance, you can specify Autopilot^TM the number of test cases that you want to generate. The maximum number of test cases is 50.
Select Generate tests to initiate the process.
When the generation finishes, you will receive a Test Case generation completed notification. Depending on your notification preferences, you can receive the notification both in-app and via email.
Select the Test generation completed notification to review the generated test cases.
1. Expand each test case in the Generate tests panel, and review the generated test cases.
2. If you are satisfied with their content, select Create tests.
If you are not satisfied with the generated test cases, select Regenerate, and provide additional details about your use case.
1. Attach more relevant documents for Autopilot^TM to use.
2. Click Next and type additional details in the Provide instructions text box.
3. After refining the steps, select Regenerate.
4. Click the Test generation completed notification to access the regenerated test cases.
5. Expand each test case and review them.
6. Select the test cases that you are satisfied with, and then select Create tests.