- Overview
- UI Automation
- Applications and technologies automated with UI Automation
- UI-ANA-016 - Pull Open Browser URL
- UI-ANA-017 - ContinueOnError True
- UI-ANA-018 - List OCR/Image Activities
- UI-DBP-006 - Container Usage
- UI-DBP-013 - Excel Automation Misuse
- UI-DBP-030 - Forbidden Variables Usage In Selectors
- ST-DBP-021 - Hardcoded Timeout
- UI-PRR-001 - Simulate Click
- UI-PRR-002 - Simulate Type
- UI-PRR-003 - Open Application Misuse
- UI-PRR-004 - Hardcoded Delays
- UI-REL-001 - Large Idx in Selectors
- UI-SEC-004 - Selector Email Data
- UI-SEC-010 - App/Url Restrictions
- UI-USG-011 - Non Allowed Attributes
- SY-USG-013 - Private File Invoke
- SY-USG-014 - Incorrect Execution Template Placeholders
- UiPath Browser Migration Tool
- Computer Vision Recorder
- Activate
- Anchor Base
- Attach Browser
- Attach Window
- Block User Input
- Call Transaction
- Callout
- Check
- Click
- Click Image
- Click Image Trigger
- Click OCR Text
- Click Picture on Screen
- Click Text
- Click Toolbar Button
- Click Trigger
- Close Application
- Close Tab
- Close Window
- Context Aware Anchor
- Copy Selected Text
- Element Attribute Change Trigger
- Element Exists
- Element Scope
- Element State Change Trigger
- Expand ALV Hierarchical Table
- Expand ALV Tree
- Expand Tree
- Export UI Tree
- Extract Structured Data
- Find Children
- Find Element
- Find Image
- Find Image Matches
- Find OCR Text Position
- Find Relative Element
- Find Text Position
- Get Active Window
- Get Ancestor
- Get Attribute
- Get Event Info
- Get From Clipboard
- Get Full Text
- Get OCR Text
- Get Password
- Get Position
- Get Source Element
- Get Text
- Get Visible Text
- Go Back
- Go Forward
- Go Home
- Google Cloud Vision OCR
- Hide Window
- Highlight
- Hotkey Trigger
- Hover
- Hover Image
- Hover OCR Text
- Hover Text
- Image Exists
- Indicate On Screen
- Inject .NET Code
- Inject JS Script
- Invoke ActiveX Method
- Key Press Trigger
- Load Image
- Maximize Window
- Microsoft Azure Computer Vision OCR
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- Minimize Window
- Monitor Events
- Mouse Trigger
- Move Window
- Navigate To
- OCR Text Exists
- On Element Appear
- On Element Vanish
- On Image Appear
- On Image Vanish
- Open Application
- Open Browser
- Read Statusbar
- Refresh Browser
- Replay User Event
- Restore Window
- SAP Login
- SAP Logon
- SAP Session Attributes Change Trigger
- Save Image
- Select Dates in Calendar
- Select Item
- Select Menu Item
- Select Multiple Items
- Send Hotkey
- Set Clipping Region
- Set Focus
- Set Text
- Set To Clipboard
- Set Web Attribute
- Show Window
- Start Process
- System Trigger
- Table Cell Scope
- Take Screenshot
- Tesseract OCR
- Text Exists
- Tooltip
- Type Into
- Type Secure Text
- Use Foreground
- Wait Attribute
- Wait Element Vanish
- Wait Image Vanish
- Application Event Trigger
- Check/Uncheck
- Check App State
- Check Element
- Click
- Click Event Trigger
- Close Popup
- Drag and Drop
- Extract Table Data
- For Each UI Element
- Get Attribute
- Get Browser Data
- Get Text
- Get URL
- Go to URL
- Highlight
- Hover
- Inject Js Script
- Keyboard Shortcuts
- Keypress Event Trigger
- Mouse Scroll
- Navigate Browser
- Select Item
- Set Browser Data
- Set Runtime Browser
- Set Text
- Take Screenshot
- Type Into
- Use Application/Browser
- Perform browser search and retrieve results using UI Automation APIs
- Web Browsing
- Find Images
- Click Images
- Trigger and Monitor Events
- Create and Override Files
- HTML Pages: Extract and Manipulate Information
- Window Manipulation
- Automated List Selection
- Find and Manipulate Window Elements
- Manage Text Automation
- Load and Process Images
- Manage Mouse Activated Actions
- Automate Application Runtime
- Automated Run of a Local Application
- Browser Navigation
- Web Automation
- Trigger Scope Example
- Computer Vision Local Server
- Mobile Automation
- Release notes
- Project compatibility
- Get Log Types
- Get Logs
- Get Page Source
- Get Device Orientation
- Get Session Identifier
- Install App
- Manage Current App
- Manage Other App
- Open DeepLink
- Open URL
- Mobile Device Connection
- Positional Swipe
- Press Hardware Button
- Set Device Orientation
- Take Screenshot
- Take Screenshot Part
- Element Exists
- Execute Command
- Get Attribute
- Get Selected Item
- Get Text
- Set Selected Item
- Set Text
- Swipe
- Tap
- Type Text
- Draw Pattern
- Terminal
Release notes
Release date: 23 October 2023
Computer Vision for Mobile Automation
Computer Vision uses UiPath's advanced neural network capabilities to enable the seamless identification of UI elements through Robots. Computer Vision empowers you to automate UI elements that were previously challenging to identify and automate. You can use Computer Vision as a selection option when indicating the target for an activity.
The activities that employ Computer Vision are:
To start using Computer Vision, you must enable it for mobile automation. Visit Enabling Computer Vision for mobile automation to learn how to enable Computer Vision for your project.
Release date: 30 May 2023
Traditional Chinese support
The Mobile Automation interface is now available in Traditional Chinese.
Release date: 7 April 2023
- Oftentimes proxies interfere with the applications you’re trying to automate mobile testing for. That’s why we made it possible for you to add custom HTTP headers into your testing projects, to ease your mobile automation experience. Custom HTTP headers allow you to work with proxies that accept only certain headers, by specifically adding them. Learn how to work with HTTP headers in our documentation.
-
The Mobile Automation activity package has been divided into two separate activity packages:
-
UiPath.Mobile.Automation.Activities - This package is used for designing and customizing workflows.
-
UiPath.Mobile.Automation.Activities.Runtime - This package is used for running workflows.
The purpose of this change is to make mobile automations run faster. If you want to both design and run your mobile automation workflows, make sure to download both packages.
-
- Add whatever text you want inside an active UI element, using the new Type Text activity! This activity takes the content that you type through the keyboard and pastes it into the currently active UI element. The Type Text activity is designed to allow users to input text into UI elements that are otherwise inaccessible via selectors. Learn more about the activity properties and how to use it in our documentation.
- The interaction between users and mobile devices is complex, sometimes requiring them to draw paths on the device screen. Now you can accomplish that by using the new Draw Pattern activity! For example, now you can automate unlocking a mobile device pattern, that requires drawing a path on the screen. Learn more about the activity properties and how to use it in our documentation.
We have updated the UX for the Swipe and Draw pattern actions in the Mobile Device Manager, providing an improved visual design. When swiping to a predefined location, you can now view the positional swipe on the Mobile Device Manager screen as a line. Additionally, swipe operations performed with Selection by absolute position enabled are imported as a Positional Swipe activity.
Release date: 7 December 2022
Updated internal dependencies to match the newest version of UIAutomation.
Release date: 5 December 2022
Release date: 24 October 2022
Target coordinates
- The activities that contain a Target selector now support expressions for offsetting a target. You can define these input arguments using Tap Offset.
- All positional activities include a Target selector to specify the element position, including a fuzzy selector and a coordinate system.
- As part of the new coordinate system, you can now use Device Independent Pixel to indicate targets based on the pixel density of the area. You can use this parameter in the Take Screenshot Part and Positional Swipe activities to run workflows on devices with similar density screens.
Release date: 26 August 2022
Automation for React Native Apps
Unable to identify the right elements for your tests? Now you can use the React Native Demo App for iOS to learn how to make specific components automatable.
Activities
-
Added two activities to help you make calls to specific API endpoints and execute native mobile commands:
Get Session Identifier: Retrieve the current session identifier to call Appium endpoints through HTTP requests.
Execute Command: Execute native mobile commands such as reading the battery info or dismissing alerts.
- You can now take capture rectangle-shaped screenshots on your mobile device screen using Take Screenshot Part.
- Added the ability to swipe to a specific location on the screen, with starting and ending points. The Positional Swipe activity is useful for objects that may not be easily automated using the standard Swipe actvitiy due to unconventiona; custom control implementation or an inaccessible web view.
- When you configure a device, the Appium Url field now provides an inline error message stating that HTTPS is not supported.
Release date: 3 August 2022
Updated internal dependencies to match the newest version of UIAutomation.
Release date: 3 August 2022
Updated internal dependencies to match the newest version of UIAutomation.
Release date: 3 August 2022
Updated internal dependencies to match the newest version of UIAutomation.
Release date: 26 April 2021
- Now you can configure the selectors in the Offline Edit mode.
- The recorded actions have been repositioned and resized to improve the UX.
- The action bar went through UI changes to achieve a more modern look.
- The visual graphics for swiping when recording actions has been removed.
- Mobile Device Manager provides support for native tablet applications however if the application has been initially developed for mobile, the support for the tablet versions is limited.
Release date: 15 December 2020
- Under specific circumstances, the Get Page Source activity returned a broken link.
- Targeting elements was not performed correctly in some cases, in the context of running two similar Android devices in Mobile Device Manager.
- In some cases, both native and web selectors were injected with an incorrect tag element.
- Changing the Studio language would scramble the location coordinates for Set Device Geolocation activities, due to the delimiter symbols being different for distinct languages, consequently, meddling with the location algorithm. This issue has now been addressed.
- Selector variables included in a While activity were available only once, during the first instance, making them unavailable for reuse.
Release date: 13 October 2020
Advanced debugging, including a timeline for executions and Appium calls, so you can have more control over your testing efforts.
Record on-screen interactions and import them directly in Studio to create mobile automation workflows.
You can now define variables to build dynamic values when you add devices and applications to Mobile Device Manager.
Switch between projects freely by importing or exporting your project, device, and application configurations.
Filtering is now available for your devices and applications.
A large pile of bugs has been swept under a big fix rug.
Release date: 6 May 2020
The new Mobile Automation activities pack offers you a suite of actions that make mobile testing very accessible. You can connect to either a local device or an Appium server, simulate all user interactions with a mobile device, as well as send and retrieve logs and information to and from the connected device.
- v23.10.4
- Bug fixes
- v23.10.3
- Bug fixes
- v23.10.2
- Bug fixes
- v23.10.1
- Bug fixes
- v23.4.3
- Bug fixes
- v22.10.6
- Bug fixes
- v23.10.0
- What's New
- Bug fixes
- Breaking change
- v23.4.2
- Bug fixes
- v22.10.5
- Bug fixes
- v22.4.6
- Bug fixes
- v21.10.7
- Bug fixes
- v23.4.1
- Improvements
- v22.10.4
- New features
- Improvements
- Bug fixes
- v23.4.0
- What's New
- Improvements
- Bug fixes
- v21.10.6
- v22.10.2
- New features
- Improvements
- v22.10.1
- Bug Fixes
- v22.8.0
- Improvements
- v22.4.5
- v20.10.10
- v21.10.5
- v21.10.4
- Improvements
- v22.4.4
- Improvements
- v21.10.3
- Improvements
- v21.10.2
- Improvements
- v20.10.9
- Improvements
- v21.10.1
- Improvements
- v21.4.4
- Improvements
- v21.4.3
- Improvements
- v20.10.8
- Improvements
- v21.4.2
- Improvements
- Limitations
- Bug Fixes
- v20.10.7
- Bug Fixes
- v20.10.6
- Bug Fixes
- v20.4.4
- Improvements
- v20.10.5
- New Features and Improvements
- v20.4.3
- Improvements
- v20.4.2
- Improvements
- v20.4.1
- New Features and Improvements
- Known Issues