Extract UI Data

Important:

The Extract UI Data activity is only available in Preview.

UiPath.Semantic.Activities.NExtractUIData

Description

Leverages AI to facilitate the extraction of UI data.

This activity must be added inside a Use Application/Browser activity.

Project compatibility

Windows | Cross-platform

Configuration

• Queries - The queries used by AI to extract specific information from the current screen. Each query is a descriptive prompt assigned to a field name for access in your workflow.
• Model - The underlying LLM model used for semantic processing. The following options are available:
  • GPT-4.1
  • GPT-4.1 mini
  • GPT-5 mini
  • Gemini 2.5 Flash
  • Gemini 3.0 Flash Preview
  • Path Mini

Properties panel

Options

• Use DOM when available - Indicates whether DOM data is sent to the LLM model for applications where DOM can be extracted.
• Continue on error - Specifies if the automation should continue even when the activity throws an error. This field only supports Boolean values (True, False). The default value is False. As a result, if the field is blank and an error is thrown, the execution of the project stops. If the value is set to True, the execution of the project continues regardless of any error.

Timings

• Delay before - Delay (in seconds) between the time the previous activity is completed and the time this activity begins performing any operations. The default value is 0.2 seconds. Adding a delay between activities ensures that one activity has enough time to complete before the next activity begins.
• Delay after - Delay (in seconds) between the time this activity is completed and the time the next activity begins any operations. The default value is 0.3 seconds. Adding a delay between activities ensures that one activity has enough time to complete before the next activity begins.
• Timeout - Specify the amount of time (in seconds) to wait for the activity to be executed before throwing an error. The default value is 30 seconds.

Output

• Result - Output argument intended for single-value queries. If the query returns multiple values, only the first value is stored in this result.
• Result (Data table) - Output argument intended for queries that return multiple values. All extracted values are stored in the table when more than one result is expected for the same query. If the number of returned values differs between queries, the extra rows under the corresponding query columns are empty.