- Overview
- UI Automation- Applications and technologies automated with UI Automation
- Project compatibility
- UI-ANA-016 - Pull Open Browser URL
- UI-ANA-017 - ContinueOnError True
- UI-ANA-018 - List OCR/Image Activities
- UI-DBP-006 - Container Usage
- UI-DBP-013 - Excel Automation Misuse
- UI-DBP-030 - Forbidden Variables Usage In Selectors
- UI-DBP-031 - Activity verification
- UI-PRR-001 - Simulate Click
- UI-PRR-002 - Simulate Type
- UI-PRR-003 - Open Application Misuse
- UI-PRR-004 - Hardcoded Delays
- UI-REL-001 - Large Idx in Selectors
- UI-SEC-004 - Selector Email Data
- UI-SEC-010 - App/Url Restrictions
- UI-USG-011 - Non Allowed Attributes
- UX-SEC-010 - App/Url Restrictions
- UX-DBP-029 - Insecure Password Use
- UI-PST-001 - Audit Log Level in Project Settings
 
- UiPath Browser Migration Tool
- Clipping region
- Computer Vision Recorder
- Activities index
- Activate
- Anchor Base
- Attach Browser
- Attach Window
- Block User Input
- Callout
- Check
- Click
- Click Image
- Click Image Trigger
- Click OCR Text
- Click Text
- Click Trigger
- Close Application
- Close Tab
- Close Window
- Context Aware Anchor
- Copy Selected Text
- Element Attribute Change Trigger
- Element Exists
- Element Scope
- Element State Change Trigger
- Export UI Tree
- Extract Structured Data
- Find Children
- Find Element
- Find Image
- Find Image Matches
- Find OCR Text Position
- Find Relative Element
- Find Text Position
- Get Active Window
- Get Ancestor
- Get Attribute
- Get Event Info
- Get From Clipboard
- Get Full Text
- Get OCR Text
- Get Password
- Get Position
- Get Source Element
- Get Text
- Get Visible Text
- Go Back
- Go Forward
- Go Home
- Google Cloud Vision OCR
- Hide Window
- Highlight
- Hotkey Trigger
- Hover
- Hover Image
- Hover OCR Text
- Hover Text
- Image Exists
- Indicate On Screen
- Inject .NET Code
- Inject Js Script
- Invoke ActiveX Method
- Key Press Trigger
- Load Image
- Maximize Window
- Microsoft Azure Computer Vision OCR
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- Minimize Window
- Monitor Events
- Mouse Trigger
- Move Window
- Navigate To
- OCR Text Exists
- On Element Appear
- On Element Vanish
- On Image Appear
- On Image Vanish
- Open Application
- Open Browser
- Refresh Browser
- Replay User Event
- Restore Window
- Save Image
- Select Item
- Select Multiple Items
- Send Hotkey
- Set Clipping Region
- Set Focus
- Set Text
- Set To Clipboard
- Set Web Attribute
- Show Window
- Start Process
- System Trigger
- Take Screenshot
- Tesseract OCR
- Text Exists
- Tooltip
- Type Into
- Type Secure Text
- Use Foreground
- Wait Attribute
- Wait Element Vanish
- Wait Image Vanish
 
- Application Event Trigger
- Block User Input
- Check/Uncheck
- Check App State
- Check Element
- Click
- Click Event Trigger
- Drag and Drop
- Extract Table Data
- For Each UI Element
- Supported Attributes for macOS
- How to analyze image color data
 
- Get Browser Data
- Get Clipboard
- Get Text
- Get URL
- Go to URL
- Highlight
- Hover
- Inject Js Script
- Keyboard Shortcuts
- Keypress Event Trigger
- Mouse Scroll
- Navigate Browser
- Select Item
- Set Browser Data
- Set Clipboard
- Set Runtime Browser
- Set Focus
- Set Text
- Take Screenshot
- Type Into
- Unblock User Input
- Use Application/Browser
- Window Operation
 
- Perform browser search and retrieve results using UI Automation APIs
- Web Browsing
- Find Images
- Click Images
- Trigger and Monitor Events
- Create and Override Files
- HTML Pages: Extract and Manipulate Information
- Window Manipulation
- Automated List Selection
- Find and Manipulate Window Elements
- Manage Text Automation
- Load and Process Images
- Manage Mouse Activated Actions
- Automate Application Runtime
- Automated Run of a Local Application
- Browser Navigation
- Web Automation
- Trigger Scope Example
- Enable UI Automation support in DevExpress
 
 
- Computer Vision Local Server
- Mobile Automation- Release notes
- About the mobile device automation architecture
- Project compatibility
- Get Log Types
- Get Logs
- Get Page Source
- Get Device Orientation
- Get Session Identifier
- Install App
- Manage Current App
- Manage Other App
- Open DeepLink
- Open URL
- Mobile Device Connection
- Directional Swipe
- Draw Pattern
- Positional Swipe
- Press Hardware Button
- Set Device Orientation
- Take Screenshot
- Take Screenshot Part
- Element Exists
- Execute Command
- Get Attribute
- Get Selected Item
- Get Text
- Set Selected Item
- Set Text
- Swipe
- Tap
- Type Text
 
 
- Terminal

UI Automation Activities
The following tables present the supported attributes for desktop applications in a macOS environment, from the Get Attribute activity.
| Attribute | Description | 
|---|---|
| app | The process name such as Google Chrome, Safari, Calculator (String). | 
| title | It specifies extra information about an element (String). Most often shown as a tooltip text when the mouse moves over the element. | 
| tid | The identifier of the thread that created the window containing the element (Int32). | 
| pid | The process identifier (Int32). | 
| role | The role of an element (String). E.g. button, link. | 
| enabled | Indicates if the element is enabled (Boolean). | 
| focused | Indicates if the element is focused (Boolean). | 
| selected | Indicates if the element is selected (Boolean). | 
| expanded | Indicates if the element is expanded (Boolean). | 
| subsystem | The subsystem used to generate the selector (String). E.g. <wnd />. | 
| text | The text content of the element (String). | 
| AppPath | The fully qualified path of the process' folder (String). E.g. /System/Applications/Calendar.app/Contents/MacOS/Calendar. | 
| AppCmdLine | A string representing the arguments used to start the process the target belongs to. For example, it would return -jar /Applications/TestApps/SwingSet2_withJava8.jarfor an application started with the command line:/usr/bin/java -jar /Applications/TestApps/SwingSet2_withJava8.jar. | 
| isminimized | Returns trueif the application is minimized,falseotherwise (String). | 
| ismaximized | Returns trueif the application is maximized,falseotherwise (String). | 
| hwnd | It retrieves the native window handle (Int32). | 
| position | The element position (Rectangle). | 
| scaleFactor | Retrieves the scale factor that is currently applied to this element (Double). On macOS scale factor and DPI scale factor are generally equal to 1. | 
| displayDpiScaleFactor | Retrieves the DPI scale factor of the display on which this element is placed (Double). On macOS scale factor and DPI scale factor are generally equal to 1. | 
| IsJavaWindow | Checks if the given window implements the Java Accessibility API (Boolean). | 
| relativeVisibility | The (partial) visibility of an element inside all of its ancestors (Boolean) | 
| visibility | It specifies a value corresponding to the following visibility levels: 0 - Visible, 1 - Hidden, 2 - Offscreen, 3 - Partial (NVisibilityLevel). | 
| foreground | Indicates if the process or browser tab is in foreground or not (Boolean). | 
| disabled | Indicates if the element is disabled (Boolean). | 
| readonly | Indicates if the element is read only (Boolean). | 
| checked | Indicates if the element is pre-selected (Boolean). | 
| items | All items of a dropdown element or list. | 
| selecteditem | The selected item of a dropdown element (String). | 
| selecteditems | Selected items, if the element supports multiple selection. | 
| isSapWinGuiSession | Indicates if the application is a SAP application (Boolean). | 
| sapClient | Available for SAP windows. | 
| sapLanguage | Available for SAP windows. | 
| sapProgram | Available for SAP windows. | 
| sapReadyState | Available for SAP windows. | 
| sapScreen | Available for SAP windows. | 
| sapSession | Available for SAP windows. | 
| sapSysName | Available for SAP windows. | 
| sapSysNumber | Available for SAP windows. | 
| sapSysSessionId | Available for SAP windows. | 
| sapTransaction | Available for SAP windows. | 
| sapUser | Available for SAP windows. | 
| sapScriptingStatus | Enum (UiSapScriptingStatus) representing the state of availabilty for SAP scripting. The following values are relevant: UI_SAP_SCRIPTING_INTERNAL_ERROR = 0, UI_SAP_SCRIPTING_DISABLED_BY_ADMINISTRATOR = 2 Available for SAP windows. | 
| Attribute | Description | 
|---|---|
| aaname | The UI element name. It represents the text that is displayed, such as 'Submit' on a button or 'First Name' for an edit box. (String). | 
| accessibleClass | The accessible Java class of the element (String). | 
| accessibleFullClass | The fully qualified accessible Java class of the element (String). | 
| backgroundColor | The background color of the element formatted as ‘(Red, Green, Blue, Alpha)’ (String). | 
| baseClassName | The underlying base Java class of the element (String). | 
| checked | An attribute which specifies that an element is pre-selected (Boolean). | 
| cls | It specifies one or more CSS classnames for an element. Or the class name of a native window handle (String). | 
| editable | Indicates if the element is editable (Boolean). | 
| enabled | Indicates if the element is enabled (Boolean). | 
| foregroundColor | The foreground color of the element formatted as ‘(Red, Green, Blue, Alpha)’ (String). | 
| fullClassName | The fully qualified name of the Java class of the element (String). | 
| hasFocus | Indicates whether the element has focus or not (Boolean). | 
| hasTableAncestor | Indicates whether the element has an ancestor with role ‘table’ or not (Int32). | 
| hwnd | It retrieves the native window handle (Int32). | 
| javastate | A list with all the available states of a java type of control (String). E.g. enabled, visible, editable. | 
| position | The element position (Rectangle). | 
| role | The role of an element (String). E.g. button, link | 
| selecteditem | The selected item of a dropdown element (String). | 
| text | The text content of the element (String) | 
| title | It specifies extra information about an element (String). Most often shown as a tooltip text when the mouse moves over the element. | 
| virtualname | The accessible virtual name of the element (String). E.g. the static text label for a combo box. | 
| visible | Indicates if the element is visible (Boolean). | 
| rowCount | Available for Table elements. | 
| columnCount | Available for Table elements. | 
| tableRow | Available for Table elements. | 
| tableCol | Available for Table elements. | 
| rowName | Available for Table elements. | 
| colName | Available for Table elements. | 
| componentName | |
| treeDepth | |
| isExpanded | |
| selecteditems | Selected items, if the element supports multiple selection. | 
| items | 
| Attribute | Description | 
|---|---|
| aastate | An array of element states, for example, "visible, enabled, selected". (String). | 
| checked | Available for the following element types: GuiCheckBox,GuiRadioButton,GuiGridViewRow,GuiGridViewColumn,GuiGridViewCell,GuiGridViewAllItems,GuiTreeItem,TableCol,TableRow,TableAllItems. | 
| colorIndex | Available for the following element types: GuiCheckBox,GuiLabel. | 
| colorIntensified | Available for the following element types: GuiCheckBox,GuiLabel. | 
| colorInverse | Available for the following element types: GuiCheckBox,GuiLabel. | 
| colName | Available for the following element types: GuiGridViewColumn,GuiGridViewCell. | 
| colTooltip | Available for the following element types: GuiGridViewCell,GuiGridView. | 
| columnCount | Available for the following element types: GuiTableControl,TableCell. | 
| focused | Indicates if the element is focused (Boolean). | 
| focuseditem | Available for GuiTree. | 
| hasFocus | Indicates whether the element has focus or not (Boolean). | 
| id | Available for all SAP controls. | 
| itemId | Available for GuiTreeItem. | 
| items | |
| labeledby | Available for all SAP controls. | 
| leafid | Available for all SAP controls. | 
| maxLength | Available for the following element types: GuiTextField,GuiCTextField,GuiPasswordField. | 
| name | Available for all SAP controls. | 
| position | The element position (Rectangle). | 
| relpath | Available for GuiTreeNode. | 
| role | The role of an element (String). E.g. button, link | 
| rowCount | Available for the following element types: GuiTableControl,GuiGridView. | 
| sapClient | Available for both SAP windows and SAP controls. | 
| sapLanguage | Available for both SAP windows and SAP controls. | 
| sapProgram | Available for both SAP windows and SAP controls. | 
| sapReadyState | Available for both SAP windows and SAP controls. | 
| sapScreen | Available for both SAP windows and SAP controls. | 
| sapSession | Available for both SAP windows and SAP controls. | 
| sapSysName | Available for both SAP windows and SAP controls. | 
| sapSysNumber | Available for both SAP windows and SAP controls. | 
| sapSysSessionId | Available for both SAP windows and SAP controls. | 
| sapTransaction | Available for both SAP windows and SAP controls. | 
| sapUser | Available for both SAP windows and SAP controls. | 
| sapScriptingStatus | Enum (UiSapScriptingStatus) representing the state of availabilty for SAP scripting. The following values are relevant: UI_SAP_SCRIPTING_INTERNAL_ERROR = 0, UI_SAP_SCRIPTING_DISABLED_BY_ADMINISTRATOR = 2 | 
| scrollmax | Available for GuiTableControl. | 
| scrollmin | Available for GuiTableControl. | 
| scrollpagesize | Available for GuiTableControl. | 
| scrollpos | Available for GuiTableControl. | 
| selecteditem | The selected item of a dropdown element (String). Available for the following element types:  GuiTree,GuiComboBox,GuiTabStrip. | 
| selectedItems | Selected items, if the element supports multiple selection. | 
| statusMessage | Available for the following element types: GuiStatusbar,GuiStatusPane. | 
| statusMessageId | Available for the following element types: GuiStatusbar,GuiStatusPane. | 
| statusMessageNumber | Available for the following element types: GuiStatusbar,GuiStatusPane. | 
| statusParameters | Available for the following element types: GuiStatusbar,GuiStatusPane. | 
| statusType | Available for the following element types: GuiStatusbar,GuiStatusPane. | 
| subsystem | The subsystem used to generate the selector (String). The selector's second level tag: webctrl, ctrl, uia, java, silverlight, sap. | 
| tableCol | Available for the following element types: GuiGridViewColumn,GuiGridViewCell,TableCell. | 
| tableRow | Available for the following element types: GuiGridViewRow,GuiGridViewCell,TableCell. | 
| text | It refers to all of the font, style, alignment, and other formatting associated with a given character or series of characters (String). Available for all SAP controls. | 
| title | It specifies extra information about an element (String). Most often shown as a tooltip text when the mouse moves over the element. | 
| tooltip | Available for all SAP controls. | 
| type | Available for all SAP controls. | 
| virtualname | The accessible virtual name of the element (String). E.g. the static text label for a combo box. | 
| visibility | It specifies a value corresponding to the following visibility levels: 0 - Visible, 1 - Hidden, 2 - Offscreen, 3 - Partial (NVisibilityLevel). | 
| visible | Indicates if the element is visible (Boolean). | 
| Attribute | Description | 
|---|---|
| role | The role of an element (String). E.g. button, link | 
| subrole | Subrole of an element, provides additional info on the element. E.g.: AXCloseButton | 
| name | The accessible name of the element (String). | 
| title | It specifies extra information about an element (String). Most often shown as a tooltip text when the mouse moves over the element. | 
| identifier | Unique identifier of an element that is often provided by the application. It is not necessarily consistent across application versions and OS versions. | 
| filename | Provides specific information for elements that represent FIles, for example, file items in Finder application. | 
| url | It specifies the URL of a browser tab. It can also be found on items that represent file items in Finder application and represent
                           a full path to the file: file:///Users/{username}/Documents/EditableNonEditable/(String). | 
| value | Gives the value of an element. Represented by the text for text elements, 0 or 1 for checkboxes, and so on (String). | 
| help | Provides an additional description text for the element (String). | 
| enabled | Indicates if the element is enabled (Boolean). | 
| focused | Indicates if the element is focused (Boolean). | 
| selected | Indicates if the element is selected (Boolean). | 
| expanded | Indicates if the element is expanded (Boolean). | 
| checked | Indicates if the element is pre-selected (Boolean). | 
| items | |
| selecteditem | The selected item of a dropdown element (String). | 
| selecteditems | Selected items, if the element supports multiple selection. |