Activities
latest
false
Banner background image
UI Automation Activities
Last updated Apr 26, 2024

v22.4

v22.4.11

Release date: 5 October 2023

Bug fixes

  • Fixed the broken Active Accessibility support for web pages containing IFrame elements or PDFs in Chrome and Edge version 117, which caused <ctrl /> selectors to fail.
    Also added the option to pass extra command-line arguments to the browser opened using the Open Browser / Use Browser activities. This can be done by setting the appropriate environment variable using the Set Environment Variable activity:
    • UIPATH_EXTRA_CMD_ARGS_CHROME
    • UIPATH_EXTRA_CMD_ARGS_EDGE
    • UIPATH_EXTRA_CMD_ARGS_FIREFOX

v22.4.10

Release date: 2 August 2023

Bug fixes

  • For MV3 extensions, the browser loads the extension later, after the web pages have loaded. To solve this kind of issues, we added the UIPATH_OPEN_BROWSER_TIMEOUT_SECONDS environment variable that allows configuring the Open Browser timeout.
  • A "Value does not fall within the expected range" error occurred when using the Data Scraping wizard (Extract Structured Data activity) in Microsoft Edge in IE Mode.
  • An error occurred when using the Data Scraping wizard (Extract Structured Data activity) on a table with an empty column header.
  • We added support for the CTable component of the Clarity Java application.

v22.4.9

Release date: 8 June 2023

Bug fixes

The latest Chrome and Edge updates to version 114 introduced a breaking change to the way support for Active Accessibility is enabled. This caused automation processes to fail when trying to interact with browser screens such as the Print popup or PDF viewer.

v22.4.8

Release date: 27 January 2023

Bug fixes

  • Fixed a bug which caused selector validation to fail in a Citrix application when two Citrix client windows were available, but only one of them actually matched a remote window.
  • Support for Chrome/Edge running in App Mode is now available in the self-hosted MV2 browser extension installed via Group Policy Offline.
  • Fixed a bug that was causing, in some cases, the CV Extract Table activity to stop before the first scroll event when extracting scrollable tables.

v22.4.7

Release date: 3 August 2022

Bug fixes

  • Automating WinForms CefSharp applications performed very slowly.
  • When automating Microsoft Edge in IE Mode, selector validation failed due to mismatched URL encoding between Edge and IE.

v22.4.6

Release date: 23 June 2022

Bug fixes

  • Certain system exceptions caused too many log entries to be recorded, making debugging cumbersome. To fix this, the log level has been changed from Error to Information.

v22.4.5

Release date: 23 May 2022

Bug fixes

  • Multiple accessibility and localization issues have been fixed.
  • When using the Check/Uncheck activity on a target that dissappeared, an exception was thrown.
  • Fixed some issues regarding F1 help links for activities.

v22.4.4

Release date: 9 May 2022

Improvements

General

The new UiPath Extension for Chrome, based on Chrome's Manifest v3 standard, has been released. This extension is fully backwards compatible, and we highly recommend you to upgrade and use it with your automation processes.

In light of the new cross-platform project type, the UI Automation package has gone through changes and now has a multitude of activities tailored to this new project type. You can read all about it here. Also, to increase the capabilities of the cross-platform projects, the new Extension for Chrome is also available on Mac

Extension management in Studio is now better than ever! The entire user experience has been revamped, offering a smoother interaction overall.

UI Automation Modern

The new For Each UI Element activity enables you to iterate through a set of actions for each UI element you have specified.

The new Inject Js Script Modern activity now offers you full JavaScript capabilities when using the Modern design experience.

A new activity, Drag and Drop has been created to enable you to perform the common drag and drop action, aiding in completing the pallete of actions that simulate human interaction.

A new Project Setting is now available, Runtime browser, enabling you to specify the browser type you want to use at runtime with the Use Application/Browser activity.

You can now use the Use Application/Browser activity with the WebDriver protocol via a new property.

The UI Automation Modern activities package now supports both design time and run time automation in multiple Windows Desktops.

One of the most highly requested features: scroll in Selection Screen, is finally here. Now, when indicating an element, you can scroll the target application without having to pause the selection using F2.

When using the Capture All Elements feature, you can now indicate a specific section of the application you are automating and extract only the elements in that area.

The Capture All Elements feature now only detects the tab in the browser you are indicating, so that toolbars and other additional, unrelated elements displayed in your browser are no longer captured.

The Take Screenshot activity can now be used outside of an Use App/Browser activity, so you can use it to take screenshots of your desktop at any time.

Object Repository now is able to display more than 5 results for multiple screens that have the same selector.

When dropping an Object Repository item over the plus sign in Studio, you are now prompted to automatically create variables based on that object.

The Mouse Scroll activity now supports adding key modifiers to the scroll action via the new Key modifiers property.

The Get Attribute activity now also displays the items attribute if the indicated element supports it.

The Click, Type Into, Check/Uncheck, and Select Item activities now have a new property field, Alter disabled element, which specifies whether you want to interact with UI elements that are disabled in the UI but can still be accessed by the Robot. Also, a new project setting has been added to the Modern activities enabling you to control this property project-wide.

A new project setting has been introduced, called Log audit information, which disables any logs generated by the Use Application/Browser activity. Also, the default logging level of the Use Application/Browser activity is now set to Verbose.

You can now switch between the available frameworks when using the Table Extraction Wizard by using the F4 hotkey.

In the Selection Screen, you can now simply click to select or deselect a highlighted target or anchor, and if you click on an empty area while outside of the add-anchor mode, you can deselect the current selection and view the helper.

The Timeout property of the Use Application/Browser activity is now automatically set to 60 seconds when indicating a window in a Remote Desktop environment.

The Select Item activity can now interact with Salesforce Lightning grouped combo boxes, as well as menu combo boxes.

UI Automation Classic

A new attribute, visibleInnerText, which reflects the actual innerText of the underlying HTML element, was added to UI Explorer.

Chrome Debugger API can now be used to send input to browser tab objects.

Attached browser type no longer replaced on selector app value if it contains a valid .exe name.

We've added support for Azure Windows Virtual Desktop client, which means you can now natively automate Azure Virtual Desktops with UI Automation activities by using the UiPath Remote Runtime and the RDP extension.

URLs can now be extracted from HTML tables. This was possible before only for structured data.

HTML elements with tag name 'HTML' are visible in UiExplorer for Chrome.

The UiPath extension for Java fully supports .jnlp type applications.

Added new injection mechanism for the UiPath extension for Java to facilitate the interaction with the application.

Improved support for Java Konsis and the custom Java Framework McBeans.

The UI Automation activities package now supports automating in nested CitrixApps.

Improved error messages for Setup Extensions and SAP WinGUI.

Implemented automatic fallback to alternative selection methods (AA for Google Chrome or Microsoft Edge and UIA for Firefox) when indicating a special tab in each of these browsers.

The Delayed Restore option from UI Explorer is now enabled by default.

Java versions 16 and 17 are now officially supported by the UI Automation activity package.

Computer Vision

The CV Extract Table activity now has two new properties. Scroll specifies whether you want to extract a scrollable table, and DelayScreenshotAfterScroll, which enables the activity to wait for a specific amount of time after performing a scroll action before taking a screenshot of the target table. The latter is useful for tables that load extra items when scrolling down. Also, when using the CV Extract Table activity, you can now use cell targeting by column and row indexes without the need to hold down the Shift key anymore.

Hitting Delete in the CV Selection Screen now deletes the current selection for quicker workflow building.

The CV Recorder no longer requires an API Key if Interactive Sign-In is used in Studio.

Computer Vision activities can now be used in StudioX by enabling the Show Developer filter.

When using CV Screen Scope, you can now toggle between Window, Element and Region Selection Types by using F3.

SAP

A new activity meant to help you identify any cell inside SAP ALV Hierarchical Table is available: Expand ALV Hierarchical Table. After you identify the cell, this activity can be used with all typical UI activities.

All SAP WinGUI activities support Object Repository integration.

A new project setting, Enforce hard timeout, is now available, enabling you to enforce a hard timeout for all activities performing SAP WinGUI automation.

Breaking changes

  • Starting with this version, sending modifier keys with the Click activity when the Input mode property is set to Simulate also sends the modifier keys using Simulate. In previous versions, the modifier keys were sent by using Hardware Events, regardless of the configuration of the Input Mode property, so please note that workflows created with previous versions might suffer breaking changes.
  • Fixed a bug that caused a Chromium-based custom browser to be recognized as a regular Windows application after upgrading to UiPath Studio v2019.x.

Bug fixes

  • Fixed a bug for Internet Explorer with Developer Tools opened that caused multiple console windows to spawn when opening UI Explorer.
  • Fixed a bug for the Send Hotkey activity that was causing the text not to be pasted into cmd.exe when changing the keyboard.
  • Generating GetHtmlAncestryInfo selectors timed out on a specific UI element from a large table.
  • Fixed a bug that caused some buttons not to be clicked or validated in Java Desktop Application by adding a new java attribute, hasTableAncestor, which is used to bypass tables when searching elements that have the attribute value set to 0.
  • Fixed a bug in Internet Explorer 8 for the Type Into activity with Simulate as input mode that prevented the keycode 8 from being typed into a search box.
  • Fixed a bug that prevented you from indicating the empty ViewPort space.
  • Fixed a bug that prevented you from reading the correct state of a checkbox inside a table in Java applications.
  • To clear the text from web pages elements, you can use empty strings with the Set Text activity again, just like in UI Automation v18.4.
  • Fixed a bug that caused the UiPath Executor to crash while indicating elements in a Java application that opens another application, which uses native libraries to draw elements on the screen.
  • Fixed a bug that prevented you from capturing the selectors from Chrome when in full screen mode.
  • Fixed a bug in Data Scraping that was throwing a timeout error when extracting extremely large HTML tables.
  • Fixed a bug that was causing the job to stop due to searching for <ctrl> selectors in parallel.
  • Fixed a bug that was crashing the target application in specific cases when trying to capture a selector using Active Accessibility.
  • Fixed a bug that prevented you from identifying certain parts of a Java application.
  • Fixed a bug in Internet Explorer that was causing the Activate Window event to fail with a timeout error, after applying the Microsoft Update KB5005031.
  • Fixed a bug in Firefox support, that caused SalesForce attributes to not appear on selector nodes and on default selectors.
  • Fixed a bug that prevented you from automating certain web pages rendered in Edge/IE mode, when the URL contains space characters %20.
  • Fixed a bug that prevented you from capturing onscreen values from a Java application.
  • Fixed a bug for Internet Explorer mode on Edge that caused the selector validation to fail.
  • Fixed a bug that was throwing a SelectorNotFound exception in the Maestro Java application when the structure of the page is very heavy with UI elements.
  • Data Scraping did not generate an Extract Structured Data activity when working with certain applications.
  • Fixed an issue which caused the Type Into activity to be unable to type the letter E on certain web pages.
  • Fixed an issue which caused Studio to freeze when indicating an anchor in certain apps.
  • Detection did not work on Microsoft Edge and Google Chrome opened in App Mode.
  • Trying to interact with certain Excel files caused Citrix Remote Runtime to crash.
  • Using a Click OCR Text activity with an invalid ApiKey caused a timeout error.
  • When taking multiple screenshots with the Take Screenshot activity, the naming convention was used starting with the second screenshot.
  • The runtime browser switcher failed to work as expectedon browsers via an RDP connection when using certain activities.
  • When using Computer Vision activities, after editing a Descriptor, the change was not reflected neither in the informative screenshot or the Selection Screen.
  • When using CV Screen Scope, indicating the full window for some Windows Native apps was very difficult because CV was using Element as Selection Type.
  • Fixed an issue which caused the CV Extract Table activity to stop working when the maximum height limit was surpassed when extracting scrollable tables.
  • Fixed an issue which caused certain Salesforce attributes to be unavailable in Firefox and Chrome.
  • When using Image activities in Chrome, if the same image existed both inside and outside the specified clipping area, the wrong image was sometimes used.

Known issues

  • To indicate an individual cell or sheet name in Excel 2016, you need to manually set AA as the selection mode. In v19.5.0, the default visual selection used AA. Starting with v21.10.4, the default visual selection uses UIA.
  • When automating Chrome with the latest Extension for Chrome, the Modern Click activity used with the Simulate input method fails on specific form elements. As a workaround, you can use the Hardware Events or Chromium API input methods.
  • Some selectors generated at design time with UI Automation v20.10 for SAP Fiori and the newest Chrome Extension can have some extra attributes which cause them to stop working when run with older versions of the Chrome Extension at runtime. As a workaround, the newest Chrome Extension should also be used at runtime, or the Selectors should be generated with at least UI Automation v21.10 at design time.
  • Events are not detected when monitoring selectors from SAP NetWeaver Business Client to SAP Fiori, both locally and over Remote Desktop connections, or selectors from SAP NetWeaver Business Client to SAP GUI over Remote Desktop connections.

Was this page helpful?

Get The Help You Need
Learning RPA - Automation Courses
UiPath Community Forum
Uipath Logo White
Trust and Security
© 2005-2024 UiPath. All rights reserved.