- Overview
- UI Automation
- Applications and technologies automated with UI Automation
- Project compatibility
- UI-ANA-016 - Pull Open Browser URL
- UI-ANA-017 - ContinueOnError True
- UI-ANA-018 - List OCR/Image Activities
- UI-DBP-006 - Container Usage
- UI-DBP-013 - Excel Automation Misuse
- UI-DBP-030 - Forbidden Variables Usage In Selectors
- UI-PRR-001 - Simulate Click
- UI-PRR-002 - Simulate Type
- UI-PRR-003 - Open Application Misuse
- UI-PRR-004 - Hardcoded Delays
- UI-REL-001 - Large Idx in Selectors
- UI-SEC-004 - Selector Email Data
- UI-SEC-010 - App/Url Restrictions
- UI-USG-011 - Non Allowed Attributes
- UX-SEC-010 - App/Url Restrictions
- UX-DBP-029 - Insecure Password Use
- UI-PST-001 - Audit Log Level in Project Settings
- UiPath Browser Migration Tool
- Clipping region
- Computer Vision Recorder
- Activate
- Anchor Base
- Attach Browser
- Attach Window
- Block User Input
- Callout
- Check
- Click
- Click Image
- Click Image Trigger
- Click OCR Text
- Click Text
- Click Trigger
- Close Application
- Close Tab
- Close Window
- Context Aware Anchor
- Copy Selected Text
- Element Attribute Change Trigger
- Element Exists
- Element Scope
- Element State Change Trigger
- Export UI Tree
- Extract Structured Data
- Find Children
- Find Element
- Find Image
- Find Image Matches
- Find OCR Text Position
- Find Relative Element
- Find Text Position
- Get Active Window
- Get Ancestor
- Get Attribute
- Get Event Info
- Get From Clipboard
- Get Full Text
- Get OCR Text
- Get Password
- Get Position
- Get Source Element
- Get Text
- Get Visible Text
- Go Back
- Go Forward
- Go Home
- Google Cloud Vision OCR
- Hide Window
- Highlight
- Hotkey Trigger
- Hover
- Hover Image
- Hover OCR Text
- Hover Text
- Image Exists
- Indicate On Screen
- Inject .NET Code
- Inject Js Script
- Invoke ActiveX Method
- Key Press Trigger
- Load Image
- Maximize Window
- Microsoft Azure Computer Vision OCR
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- Minimize Window
- Monitor Events
- Mouse Trigger
- Move Window
- Navigate To
- OCR Text Exists
- On Element Appear
- On Element Vanish
- On Image Appear
- On Image Vanish
- Open Application
- Open Browser
- Refresh Browser
- Replay User Event
- Restore Window
- Save Image
- Select Item
- Select Multiple Items
- Send Hotkey
- Set Clipping Region
- Set Focus
- Set Text
- Set To Clipboard
- Set Web Attribute
- Show Window
- Start Process
- System Trigger
- Take Screenshot
- Tesseract OCR
- Text Exists
- Tooltip
- Type Into
- Type Secure Text
- Use Foreground
- Wait Attribute
- Wait Element Vanish
- Wait Image Vanish
- Application Event Trigger
- Check/Uncheck
- Check App State
- Check Element
- Click
- Click Event Trigger
- Drag and Drop
- Extract Table Data
- For Each UI Element
- Get Attribute
- Get Browser Data
- Get Text
- Get URL
- Go to URL
- Highlight
- Hover
- Inject Js Script
- Keyboard Shortcuts
- Keypress Event Trigger
- Mouse Scroll
- Navigate Browser
- Select Item
- Set Browser Data
- Set Runtime Browser
- Set Text
- Take Screenshot
- Type Into
- Use Application/Browser
- Perform browser search and retrieve results using UI Automation APIs
- Web Browsing
- Find Images
- Click Images
- Trigger and Monitor Events
- Create and Override Files
- HTML Pages: Extract and Manipulate Information
- Window Manipulation
- Automated List Selection
- Find and Manipulate Window Elements
- Manage Text Automation
- Load and Process Images
- Manage Mouse Activated Actions
- Automate Application Runtime
- Automated Run of a Local Application
- Browser Navigation
- Web Automation
- Trigger Scope Example
- Enable UI Automation support in DevExpress
- Computer Vision Local Server
- Mobile Automation
- Release notes
- Project compatibility
- Get Log Types
- Get Logs
- Get Page Source
- Get Device Orientation
- Get Session Identifier
- Install App
- Manage Current App
- Manage Other App
- Open DeepLink
- Open URL
- Mobile Device Connection
- Directional Swipe
- Draw Pattern
- Positional Swipe
- Press Hardware Button
- Set Device Orientation
- Take Screenshot
- Take Screenshot Part
- Element Exists
- Execute Command
- Get Attribute
- Get Selected Item
- Get Text
- Set Selected Item
- Set Text
- Swipe
- Tap
- Type Text
- Terminal
UI Automation Activities
OUT OF SUPPORTv20.10
Release date: October 5, 2023
-
Fixed the broken Active Accessibility support for web pages containing IFrame elements or PDFs in Chrome and Edge version 117, which caused
<ctrl />
selectors to fail.Also added the option to pass extra command-line arguments to the browser opened using the Open Browser / Use Browser activities. This can be done by setting the appropriate environment variable using the Set Environment Variable activity:UIPATH_EXTRA_CMD_ARGS_CHROME
UIPATH_EXTRA_CMD_ARGS_EDGE
UIPATH_EXTRA_CMD_ARGS_FIREFOX
Release date: June 8, 2023
Release date: December 7, 2022
visibleInnerText
attribute is now available in the Selector
Attributes panel from UI Explorer.
Release date: August 3, 2022
- Azure Windows Virtual Desktop
(
msdrc.exe
) was not supported by UI Automation. The new process name associated with Azure Windows Virtual Desktop has been added, and is now supported. - When automating Microsoft Edge in IE Mode, selector validation failed due to mismatched URL encoding between Edge and IE.
- When using the Type Into
activity with the Simulate Type input method, the number
8
could not be typed in certain applications.
Release date: November 25, 2021
Release date: June 2, 2021
- Java Bridge could not be installed from UI Explorer.
- The On Image Appear activity displayed a corrupted screenshot when indicating the target for the first time.
- Fixed performance issues with the Get Attribute, Get Position, Get Text, Text Exists, OCR Text Exists activities.
- Fixed an issue that caused certain webpages in Chrome to freeze the entire OS when indicating with an Use Application/Browser activity.
- When using the Call
Transaction and SAP Login activities running XenApp in an App-V
container, the
Enter
key was not performed. - SAPGUI scripting did not work for automating SAP Logon applications published as App-V.
- The Click activity stopped working when a window froze in the foreground during runtime.
- After indicating an element or an Anchor, UI Explorer was unable to return to the foreground.
- When using the Indicate Element and Repair features, multiple Selector Editor windows were opened.
Release date: February 8, 2021
Release date: December 14, 2020
- When automating an app that had multiple window instances, inside a Use Application/Browser container with Attach Mode set to Application Instance, manually modifying the selector of a Click activity to an inexistent one caused the entire target application to be targeted instead of the initial element. This happened only when the Selector check box was selected.
Release date: December 10, 2020
The Double Click action has been added to the Action Picker menu in the Recorder.
The window selector is now shown when editing a descriptor in offline mode.
- The Extract Table Data activity can now be used with the Object Repository feature in Studio.
- Fixed an issue that caused wrong files to be invoked by the Invoke Process activity.
- JavaState attribute matching was not correctly performed.
- Fixed an issue that caused Type Into with SimulateType to fail when used with Lawson in Chrome.
- The Click Image activity did not use the values that were set in the Timeout and WaitForReady property fields.
- A Null Pointer exception was triggered when retrieving text from an NRichLabel in Nexaweb environments.
Release date: October 20, 2020
Release date: October 12, 2020
The UI Automation and UI Automation Next activity packages have been merged under the UI Automation v20.10.5 activity package, containing the best of both worlds, now taking advantage of the new Unified Target technology, which brings all of the targeting methods together, making all your automation endeavors much easier.
Also, some activities have been reworked to support the Unified Target technology. However, we haven't removed their old counterparts from the package, you can simply opt whether to use them or not by selecting the Modern experience from the Design tab in Studio Backstage Settings.
Choosing the Modern experience also grants you access to the new App/Web Recorder, which is a single recorder to rule them all, replacing all previous UI Automation recorders with a new, anchor-based, multi-technology element identification system that makes recording your actions considerably easier and faster.
You can install the unified UI Automation activity package even on Studio v2020.4.1 or lower. Doing this displays all the classic and modern activities in the Activities pane. Please note, however, that wizards that require newer Studio/Robot versions than 2020.4.1 are not available in older versions.
The new Modify Text activity updates a specified text by using methods such as find and replace, trim, or concatenation, offering you multiple new ways to manipulate any text files you might need to.
Improved the message displayed for the Type Into activity if the EmptyField field is not filled in.
The GetProcessNameByPid and GetWindowProcessName attributes now return a lowercase value instead of the raw process name, which had to be converted to lowercase.
The Google Cloud Vision OCR activity received a new option, named DetectionMode.
To increase support in dealing with troublesome UIs of WPF and WInForms Windows applications, we have created the new Inject .NET Code activity, which enables you to inject .NET code in any target application.
We have now added support for User Events monitoring for Citrix desktops and apps, as well as automations over RDP.
true
for all input methods, while the <idx>
attribute with a large value was unreliable.
JSpinner
arrow elements in Java applications.
<cls>
attribute.
Take Screenshot - This new activity enables you to take a screenshot of a specified UI element and save it as an image file.
You can now place Use Application/Browser activities one inside another. This gives you more flexibility when designing automations that work with multiple applications.
A new option named Configure every step is available in the App/Web Recorder. When it is enabled, the following changes occur before a step is recorded:
- Target selection is no longer made automatically after you click the UI element to interact with. You can add or remove anchors, remove and add the target again after indicating it, and confirm the selection.
- When adding the Get Text action, you are prompted to save the value.
The App/Web Recorder now remembers the last position where you moved it on the screen. When you close it and launch it again, the Recorder opens in the same position where you last left it.
We have developed a completely new scope activity for triggers, called Trigger Scope. This activity can be found in the System activity package v20.10.1 but is usable with all the triggers present in both UI Automation and System activity packages. It offers the required arguments to work with the trigger out of the box, like trigger name and type or its source event. Moreover, it can treat the incoming events sequentially or concurrently while it can exit after one execution.
We have added several new trigger activities, and redesigned some of the existing triggers, moving the most used properties at hand. The new activities are:
- Element Attribute Change Trigger
- Element State Change Trigger
Most importantly, we have democratized trigger development. We provide a trigger SDK for everyone to use and develop custom triggers, just like you do with custom activities. You can read more about this here.
Two new Workflow Analyzer rules have been added, as follows:
- Forbidden Variables Usage In Selectors enables you to scan for all UI Automation activities that use variables in selectors, thus removing any risks of using non-compliant selectors in your automation processes.
- Insecure Password Use checks
if any Type Into activities used in your workflow use plain text to type passwords
instead of
SecureString
variables.
This release brings an update to the user experience offered by the CV activities by modifying the way screens you are working with are cached. The new cache strategy saves all of the screens you are working on within the CV Screen Scope activity and allows you to perform actions on them at design time in an easier fashion.
DataTable
variable for
further use.
The CV Get Text activity now also has the RefreshBefore check box, which, when selected, enables you to scan again using the Computer Vision neural network for any changes since the first CV Screen Scope scan.
The new Table Cell Scope activity enables you to attach to an existing Table UI element and perform multiple actions within it. This activity is specifically tailored for SAP WinGUI automation.
We’re extending the capabilities for creating automation projects for SAP. As such, this release, will make it possible and easy to automate SAP FIORI by building selectors out-of-the-box.
The default value for the SAP Logon activity is now retrieved from the corresponding registry entry.
<colTooltip>
attribute to indicate the column name.
- A fix for the Take Screenshot activity causes all exceptions in the activity to be handled differently. Before the fix, any exception simply caused the screenshot to be returned as null, but now, the exception is thrown normally, stopping workflow execution. This can cause breaking changes in already existing workflows.
- A fix for the Click before typing property in Java applications causes the cursor to be placed after the existing text instead of at the beginning of the existing text when a Type Into activity with Activate selected and Click before typing set to Single or Double is used in a Java application.
- On rare occasions, target and anchor pairs created in version 2020.4.x may fail to identify the correct element in this version. To fix this issue, select the anchor again or add another anchor for the target.
- Fixed an issue with the Attach
Window activity which did not properly function on Java applications when
the process was started from Orchestrator. The issue occurred after a Windows update
was performed. Please note that you are not prompted to install the extension for
Java if the
awt.dll
file is not loaded in the target Java application. This is done to prevent the installation pop-up from showing up when applications cannot be automated through Java selectors. You can read more about the extension for Java on this page. - Improved the selector generation for
the Microsoft Teams application by fixing the
<cls>
tag which was incorrectly generated. - The Key press trigger activity
would fail to detect an element if its selector contained the
<idx>
attribute. - In some cases, a drop-down or context menu would disappear right before the Click or Hover activities could interact with them. This has now been fixed.
- The Key press trigger activity did not function correctly when used on SAP WinGUI elements.
- We fixed an issue in the App/Web Recorder that sometimes made the Choose action hover menu difficult to click.
- When Acrobat Reader DC is the target application for a Use Application/Browser activity which has the Open property set to Always, an error no longer occurs if Acrobat is already open. The activity now attaches to the existing Acrobat window. For example, if a PDF file path is provided as an argument, the file is opened in a new tab in the existing Acrobat Reader DC window.
- The Object Repository does not currently support the Extract Table Data activity.
- Some C# expressions might not work when used with the OCR engine in a CV Screen Scope activity. A workaround for this issue is using an Assign activity before the CV Screen Scope activity to run the expression.
- The Invoke Workflow File activity is unable to open the correct file at runtime when a previous activity alters the target directory.
- When automating an app that has multiple window instances, inside an Use Application/Browser container with Attach Mode set to Application Instance, manually modifying the selector of a Click activity to an inexistent one causes the entire target application to be targeted instead of the initial element. This happens only when the Selector check box is selected.
- v20.10.15
- Bug fixes
- v20.10.14
- Bug fixes
- v20.10.13
- Improvements
- Bug fixes
- v20.10.12
- Bug fixes
- v20.10.11
- Bug fixes
- v20.10.10
- Bug fixes
- v20.10.9
- Bug fixes
- v20.10.8
- Bug fixes
- v20.10.7
- Improvements
- Bug fixes
- Known issues
- v20.10.6
- Bug fixes
- v20.10.5
- Merging UI Automation and UI Automation Next
- General improvements
- UI Automation Modern
- Desktop triggers
- Workflow Analyzer Rules
- Computer Vision
- SAP
- Breaking changes
- Bug fixes
- Known issues