- Overview
- UI Automation
- UI-ANA-016 - Pull Open Browser URL
- UI-ANA-017 - ContinueOnError True
- UI-ANA-018 - List OCR/Image Activities
- UI-DBP-006 - Container Usage
- UI-DBP-013 - Excel Automation Misuse
- UI-DBP-030 - Forbidden Variables Usage In Selectors
- ST-DBP-021 - Hardcoded Timeout
- UI-PRR-001 - Simulate Click
- UI-PRR-002 - Simulate Type
- UI-PRR-003 - Open Application Misuse
- UI-PRR-004 - Hardcoded Delays
- UI-REL-001 - Large Idx in Selectors
- UI-SEC-004 - Selector Email Data
- UI-SEC-010 - App/Url Restrictions
- UI-USG-011 - Non Allowed Attributes
- SY-USG-013 - Private File Invoke
- SY-USG-014 - Incorrect Execution Template Placeholders
- Applications and technologies automated with UI Automation
- UiPath Browser Migration Tool
- Computer Vision Recorder
- Click
- Hover
- Type Secure Text
- Send Hotkey
- Type Into
- Check
- Select Item
- Select Multiple Items
- Get Text
- Set Text
- Activate
- Highlight
- Set Focus
- Anchor Base
- Context Aware Anchor
- Find Relative Element
- Indicate On Screen
- Element Exists
- Find Element
- Wait Element Vanish
- Find Children
- Get Ancestor
- Element Scope
- Get Attribute
- Set Clipping Region
- Get Position
- Take Screenshot
- Wait Attribute
- On Element Appear
- On Element Vanish
- Click Text
- Hover Text
- Find Text Position
- Get Full Text
- Get Visible Text
- Extract Structured Data
- Text Exists
- Click OCR Text
- Hover OCR Text
- Get OCR Text
- Find OCR Text Position
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- Microsoft Azure Computer Vision OCR
- Tesseract OCR
- Google Cloud Vision OCR
- OCR Text Exists
- Click Image
- Hover Image
- Find Image Matches
- Image Exists
- Find Image
- Wait Image Vanish
- On Image Appear
- On Image Vanish
- Load Image
- Save Image
- Attach Browser
- Close Tab
- Go Back
- Go Forward
- Go Home
- Inject JS Script
- Navigate To
- Open Browser
- Refresh Browser
- Set Web Attribute
- Attach Window
- Close Window
- Get Active Window
- Hide Window
- Maximize Window
- Minimize Window
- Move Window
- Restore Window
- Show Window
- Export UI Tree
- Invoke ActiveX Method
- Inject .NET Code
- Click Trigger
- Key Press Trigger
- Click Image Trigger
- System Trigger
- Hotkey Trigger
- Mouse Trigger
- Get Event Info
- Monitor Events
- Get Source Element
- Replay User Event
- Block User Input
- Use Foreground
- Element Attribute Change Trigger
- Element State Change Trigger
- Callout
- Copy Selected Text
- Get From Clipboard
- Set To Clipboard
- Close Application
- Open Application
- Start Process
- Get Password
- Tooltip
- Click Picture on Screen
- Click Toolbar Button
- Read Statusbar
- Select Dates in Calendar
- Select Menu Item
- Expand Tree
- Call Transaction
- SAP Logon
- SAP Login
- Table Cell Scope
- SAP Session Attributes Change Trigger
- Expand ALV Tree
- Expand ALV Hierarchical Table
- Use Application/Browser
- Check App State
- Check/Uncheck
- Click
- Extract Table Data
- Get Text
- Get URL
- Go to URL
- Highlight
- Hover
- Keyboard Shortcuts
- Navigate Browser
- Select Item
- Take Screenshot
- Type Into
- Get Attribute
- Get Browser Data
- Set Browser Data
- Mouse Scroll
- Inject Js Script
- Drag and Drop
- For Each UI Element
- Application Event Trigger
- Click Event Trigger
- Keypress Event Trigger
- Set Text
- Check Element
- Fill Form
- Perform browser search and retrieve results using UI Automation APIs
- Web Browsing
- Find Images
- Click Images
- Trigger and Monitor Events
- Create and Override Files
- HTML Pages: Extract and Manipulate Information
- Window Manipulation
- Automated List Selection
- Find and Manipulate Window Elements
- Manage Text Automation
- Load and Process Images
- Manage Mouse Activated Actions
- Automate Application Runtime
- Automated Run of a Local Application
- Browser Navigation
- Web Automation
- Trigger Scope Example
- Computer Vision Local Server
- Mobile Automation
- Release notes
- Project compatibility
- Get Log Types
- Get Logs
- Get Page Source
- Get Device Orientation
- Get Session Identifier
- Install App
- Manage Current App
- Manage Other App
- Open DeepLink
- Open URL
- Mobile Device Connection
- Positional Swipe
- Press Hardware Button
- Set Device Orientation
- Take Screenshot
- Take Screenshot Part
- Element Exists
- Execute Command
- Get Attribute
- Get Selected Item
- Get Text
- Set Selected Item
- Set Text
- Swipe
- Tap
- Type Text
- Draw Pattern
- Terminal
Release notes
Release date: 23 October 2023
Computer Vision for Mobile Automation
Computer Vision uses UiPath's advanced neural network capabilities to enable the seamless identification of UI elements through Robots. Computer Vision empowers you to automate UI elements that were previously challenging to identify and automate. You can use Computer Vision as a selection option when indicating the target for an activity.
The activities that employ Computer Vision are:
To start using Computer Vision, you must enable it for mobile automation. Visit Enabling Computer Vision for mobile automation to learn how to enable Computer Vision for your project.
Release date: 30 May 2023
Traditional Chinese support
The Mobile Automation interface is now available in Traditional Chinese.
Release date: 7 April 2023
- Oftentimes proxies interfere with the applications you’re trying to automate mobile testing for. That’s why we made it possible for you to add custom HTTP headers into your testing projects, to ease your mobile automation experience. Custom HTTP headers allow you to work with proxies that accept only certain headers, by specifically adding them. Learn how to work with HTTP headers in our documentation.
-
The Mobile Automation activity package has been divided into two separate activity packages:
-
UiPath.Mobile.Automation.Activities - This package is used for designing and customizing workflows.
-
UiPath.Mobile.Automation.Activities.Runtime - This package is used for running workflows.
The purpose of this change is to make mobile automations run faster. If you want to both design and run your mobile automation workflows, make sure to download both packages.
-
- Add whatever text you want inside an active UI element, using the new Type Text activity! This activity takes the content that you type through the keyboard and pastes it into the currently active UI element. The Type Text activity is designed to allow users to input text into UI elements that are otherwise inaccessible via selectors. Learn more about the activity properties and how to use it in our documentation.
- The interaction between users and mobile devices is complex, sometimes requiring them to draw paths on the device screen. Now you can accomplish that by using the new Draw Pattern activity! For example, now you can automate unlocking a mobile device pattern, that requires drawing a path on the screen. Learn more about the activity properties and how to use it in our documentation.
We have updated the UX for the Swipe and Draw pattern actions in the Mobile Device Manager, providing an improved visual design. When swiping to a predefined location, you can now view the positional swipe on the Mobile Device Manager screen as a line. Additionally, swipe operations performed with Selection by absolute position enabled are imported as a Positional Swipe activity.
Release date: 7 December 2022
Updated internal dependencies to match the newest version of UIAutomation.
Release date: 5 December 2022
Release date: 24 October 2022
Target coordinates
- The activities that contain a Target selector now support expressions for offsetting a target. You can define these input arguments using Tap Offset.
- All positional activities include a Target selector to specify the element position, including a fuzzy selector and a coordinate system.
- As part of the new coordinate system, you can now use Device Independent Pixel to indicate targets based on the pixel density of the area. You can use this parameter in the Take Screenshot Part and Positional Swipe activities to run workflows on devices with similar density screens.
Release date: 26 August 2022
Automation for React Native Apps
Unable to identify the right elements for your tests? Now you can use the React Native Demo App for iOS to learn how to make specific components automatable.
Activities
-
Added two activities to help you make calls to specific API endpoints and execute native mobile commands:
Get Session Identifier: Retrieve the current session identifier to call Appium endpoints through HTTP requests.
Execute Command: Execute native mobile commands such as reading the battery info or dismissing alerts.
- You can now take capture rectangle-shaped screenshots on your mobile device screen using Take Screenshot Part.
- Added the ability to swipe to a specific location on the screen, with starting and ending points. The Positional Swipe activity is useful for objects that may not be easily automated using the standard Swipe actvitiy due to unconventiona; custom control implementation or an inaccessible web view.
- When you configure a device, the Appium Url field now provides an inline error message stating that HTTPS is not supported.
Release date: 3 August 2022
Updated internal dependencies to match the newest version of UIAutomation.
Release date: 3 August 2022
Updated internal dependencies to match the newest version of UIAutomation.
Release date: 3 August 2022
Updated internal dependencies to match the newest version of UIAutomation.
Release date: 26 April 2021
- Now you can configure the selectors in the Offline Edit mode.
- The recorded actions have been repositioned and resized to improve the UX.
- The action bar went through UI changes to achieve a more modern look.
- The visual graphics for swiping when recording actions has been removed.
- Mobile Device Manager provides support for native tablet applications however if the application has been initially developed for mobile, the support for the tablet versions is limited.
Release date: 15 December 2020
- Under specific circumstances, the Get Page Source activity returned a broken link.
- Targeting elements was not performed correctly in some cases, in the context of running two similar Android devices in Mobile Device Manager.
- In some cases, both native and web selectors were injected with an incorrect tag element.
- Changing the Studio language would scramble the location coordinates for Set Device Geolocation activities, due to the delimiter symbols being different for distinct languages, consequently, meddling with the location algorithm. This issue has now been addressed.
- Selector variables included in a While activity were available only once, during the first instance, making them unavailable for reuse.
Release date: 13 October 2020
Advanced debugging, including a timeline for executions and Appium calls, so you can have more control over your testing efforts.
Record on-screen interactions and import them directly in Studio to create mobile automation workflows.
You can now define variables to build dynamic values when you add devices and applications to Mobile Device Manager.
Switch between projects freely by importing or exporting your project, device, and application configurations.
Filtering is now available for your devices and applications.
A large pile of bugs has been swept under a big fix rug.
Release date: 6 May 2020
The new Mobile Automation activities pack offers you a suite of actions that make mobile testing very accessible. You can connect to either a local device or an Appium server, simulate all user interactions with a mobile device, as well as send and retrieve logs and information to and from the connected device.
- V23.10.4
- Bug fixes
- v23.10.3
- Bug fixes
- v23.10.2
- Bug fixes
- v23.10.1
- Bug fixes
- v23.4.3
- Bug fixes
- v22.10.6
- Bug fixes
- v23.10.0
- What's New
- Bug fixes
- Breaking change
- v23.4.2
- Bug fixes
- v22.10.5
- Bug fixes
- v22.4.6
- Bug fixes
- v21.10.7
- Bug fixes
- v23.4.1
- Improvements
- v22.10.4
- New features
- Improvements
- Bug fixes
- v23.4.0
- What's New
- Improvements
- Bug fixes
- v21.10.6
- v22.10.2
- New features
- Improvements
- v22.10.1
- Bug Fixes
- v22.8.0
- Improvements
- v22.4.5
- v20.10.10
- v21.10.5
- v21.10.4
- Improvements
- v22.4.4
- Improvements
- v21.10.3
- Improvements
- v21.10.2
- Improvements
- v20.10.9
- Improvements
- v21.10.1
- Improvements
- v21.4.4
- Improvements
- v21.4.3
- Improvements
- v20.10.8
- Improvements
- v21.4.2
- Improvements
- Limitations
- Bug Fixes
- v20.10.7
- Bug Fixes
- v20.10.6
- Bug Fixes
- v20.4.4
- Improvements
- v20.10.5
- New Features and Improvements
- v20.4.3
- Improvements
- v20.4.2
- Improvements
- v20.4.1
- New Features and Improvements
- Known Issues
