- Overview
- UI Automation
- Applications and technologies automated with UI Automation
- Project compatibility
- UI-ANA-016 - Pull Open Browser URL
- UI-ANA-017 - ContinueOnError True
- UI-ANA-018 - List OCR/Image Activities
- UI-DBP-006 - Container Usage
- UI-DBP-013 - Excel Automation Misuse
- UI-DBP-030 - Forbidden Variables Usage In Selectors
- UI-PRR-001 - Simulate Click
- UI-PRR-002 - Simulate Type
- UI-PRR-003 - Open Application Misuse
- UI-PRR-004 - Hardcoded Delays
- UI-REL-001 - Large Idx in Selectors
- UI-SEC-004 - Selector Email Data
- UI-SEC-010 - App/Url Restrictions
- UI-USG-011 - Non Allowed Attributes
- UX-SEC-010 - App/Url Restrictions
- UX-DBP-029 - Insecure Password Use
- UI-PST-001 - Audit Log Level in Project Settings
- UiPath Browser Migration Tool
- Clipping region
- Computer Vision Recorder
- Activities index
- Activate
- Anchor Base
- Attach Browser
- Attach Window
- Block User Input
- Callout
- Check
- Click
- Click Image
- Click Image Trigger
- Click OCR Text
- Click Text
- Click Trigger
- Close Application
- Close Tab
- Close Window
- Context Aware Anchor
- Copy Selected Text
- Element Attribute Change Trigger
- Element Exists
- Element Scope
- Element State Change Trigger
- Export UI Tree
- Extract Structured Data
- Find Children
- Find Element
- Find Image
- Find Image Matches
- Find OCR Text Position
- Find Relative Element
- Find Text Position
- Get Active Window
- Get Ancestor
- Get Attribute
- Get Event Info
- Get From Clipboard
- Get Full Text
- Get OCR Text
- Get Password
- Get Position
- Get Source Element
- Get Text
- Get Visible Text
- Go Back
- Go Forward
- Go Home
- Google Cloud Vision OCR
- Hide Window
- Highlight
- Hotkey Trigger
- Hover
- Hover Image
- Hover OCR Text
- Hover Text
- Image Exists
- Indicate On Screen
- Inject .NET Code
- Inject Js Script
- Invoke ActiveX Method
- Key Press Trigger
- Load Image
- Maximize Window
- Microsoft Azure Computer Vision OCR
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- Minimize Window
- Monitor Events
- Mouse Trigger
- Move Window
- Navigate To
- OCR Text Exists
- On Element Appear
- On Element Vanish
- On Image Appear
- On Image Vanish
- Open Application
- Open Browser
- Refresh Browser
- Replay User Event
- Restore Window
- Save Image
- Select Item
- Select Multiple Items
- Send Hotkey
- Set Clipping Region
- Set Focus
- Set Text
- Set To Clipboard
- Set Web Attribute
- Show Window
- Start Process
- System Trigger
- Take Screenshot
- Tesseract OCR
- Text Exists
- Tooltip
- Type Into
- Type Secure Text
- Use Foreground
- Wait Attribute
- Wait Element Vanish
- Wait Image Vanish
- Application Event Trigger
- Check/Uncheck
- Check App State
- Check Element
- Click
- Click Event Trigger
- Drag and Drop
- Extract Table Data
- For Each UI Element
- Get Attribute
- Get Browser Data
- Get Text
- Get URL
- Go to URL
- Highlight
- Hover
- Inject Js Script
- Keyboard Shortcuts
- Keypress Event Trigger
- Mouse Scroll
- Navigate Browser
- Select Item
- Set Browser Data
- Set Runtime Browser
- Set Text
- Take Screenshot
- Type Into
- Use Application/Browser
- Perform browser search and retrieve results using UI Automation APIs
- Web Browsing
- Find Images
- Click Images
- Trigger and Monitor Events
- Create and Override Files
- HTML Pages: Extract and Manipulate Information
- Window Manipulation
- Automated List Selection
- Find and Manipulate Window Elements
- Manage Text Automation
- Load and Process Images
- Manage Mouse Activated Actions
- Automate Application Runtime
- Automated Run of a Local Application
- Browser Navigation
- Web Automation
- Trigger Scope Example
- Enable UI Automation support in DevExpress
- Computer Vision Local Server
- Mobile Automation
- Release notes
- Project compatibility
- Get Log Types
- Get Logs
- Get Page Source
- Get Device Orientation
- Get Session Identifier
- Install App
- Manage Current App
- Manage Other App
- Open DeepLink
- Open URL
- Mobile Device Connection
- Directional Swipe
- Draw Pattern
- Positional Swipe
- Press Hardware Button
- Set Device Orientation
- Take Screenshot
- Take Screenshot Part
- Element Exists
- Execute Command
- Get Attribute
- Get Selected Item
- Get Text
- Set Selected Item
- Set Text
- Swipe
- Tap
- Type Text
- Terminal
UI Automation Activities
Release notes
Release date: October 18, 2024
Directional Swipe activity and API
Perform quick and easy swipes in the mobile application that you are testing, using the Directional Swipe activity and API. Directional Swipe allows you to perform swipe actions for the following pre-defined directions: Up, Down, Left, and Right.
- Directional Swipe activity
- DirectionalSwipe API
Release date: September 5, 2024
We are constantly working to improve your mobile automation experience. Even though there are no significant changes this release, we made minor improvements to the product.
Release date: August 9, 2024
We are constantly working to improve your mobile automation experience. Even though there are no significant changes this release, we made minor improvements to the product.
Release date: July 1, 2024
Mobile Automation APIs and coded workflow support
If you prefer code when building automation, you can now achieve this using coded automations and UiPath services. The Mobile Automation activities package now includes APIs that enable you to create automations for your mobile testing scenarios.
Visit Mobile automation APIs to browse through the available APIs and Coded automation to learn more about coded automations in UiPath® Studio.
Computer vision support for Swipe
You can now use Computer Vision as a selection option when indicating the target of the Swipe activity.
Computer vision for mobile automation available for recordings
You can now use Computer vision for mobile automations from the Mobile Device Manager (MDM), when recording actions. After you connect your device with an application, from the Action bar, select Enable CV recording. Visit Device interaction to check the available actions within MDM.
Enhanced the performance of the Mobile Device Manager, making your mobile device automations faster.
For more efficient debugging, you can now copy the output messages from the MDM log.
Release date: June 11, 2024
- For some iOS versions and devices, indicating a UI element in the Mobile Device Manager, threw the following error: "Value does not fall within the expected range".
- For some iOS versios and devices, selecting a UI element, using the selection options, failed to focus on the indicated element.
Release date: October 23, 2023
Computer Vision for Mobile Automation
Computer Vision uses UiPath's advanced neural network capabilities to enable the seamless identification of UI elements through Robots. Computer Vision empowers you to automate UI elements that were previously challenging to identify and automate. You can use Computer Vision as a selection option when indicating the target for an activity.
The activities that employ Computer Vision are:
- Get Text
- Set Text
- Tap
- Element Exists
To start using Computer Vision, you must enable it for mobile automation. Visit Enabling Computer Vision for mobile automation to learn how to enable Computer Vision for your project.
- During the connection to an iOS simulator or real device from Sauce Labs, the pixel ratio of the device failed to update by default in Mobile Device Manager.
Release date: May 30, 2023
Traditional Chinese support
The Mobile Automation interface is now available in Traditional Chinese.
Release date: April 7, 2023
Oftentimes proxies interfere with the applications you’re trying to automate mobile testing for. That’s why we made it possible for you to add custom HTTP headers into your testing projects, to ease your mobile automation experience. Custom HTTP headers allow you to work with proxies that accept only certain headers, by specifically adding them.
The Mobile Automation activity package has been divided into two separate activity packages:
-
UiPath.Mobile.Automation.Activities - This package is used for designing and customizing workflows.
-
UiPath.Mobile.Automation.Activities.Runtime - This package is used for running workflows.
The purpose of this change is to make mobile automations run faster. If you want to both design and run your mobile automation workflows, make sure to download both packages.
Add whatever text you want inside an active UI element, using the new Type Text activity! This activity takes the content that you type through the keyboard and pastes it into the currently active UI element. The Type Text activity is designed to allow users to input text into UI elements that are otherwise inaccessible via selectors.
The interaction between users and mobile devices is complex, sometimes requiring them to draw paths on the device screen. Now you can accomplish that by using the new Draw Pattern activity! For example, now you can automate unlocking a mobile device pattern, that requires drawing a path on the screen.
We have updated the UX for the Swipe and Draw pattern actions in the Mobile Device Manager, providing an improved visual design. When swiping to a predefined location, you can now view the positional swipe on the Mobile Device Manager screen as a line. Additionally, swipe operations performed with Selection by absolute position enabled are imported as a Positional Swipe activity.
Release date: December 5, 2022
Release date: October 24, 2022
Target coordinates
The activities that contain a Target selector now support expressions for offsetting a target. You can define these input arguments using Tap Offset.
All positional activities include a Target selector to specify the element position, including a fuzzy selector and a coordinate system.
As part of the new coordinate system, you can now use Device Independent Pixel to indicate targets based on the pixel density of the area. You can use this parameter in the Take Screenshot Part and Positional Swipe activities to run workflows on devices with similar density screens.
Release date: August 26, 2022
Automation for React Native Apps
Unable to identify the right elements for your tests? Now you can use the React Native Demo App for iOS to learn how to make specific components automatable.
Activities
Added two activities to help you make calls to specific API endpoints and execute native mobile commands:
- Get Session Identifier: Retrieve the current session identifier to call Appium endpoints through HTTP requests.
- Execute Command: Execute native mobile commands such as reading the battery info or dismissing alerts.
You can now take capture rectangle-shaped screenshots on your mobile device screen using Take Screenshot Part.
Added the ability to swipe to a specific location on the screen, with starting and ending points. The Positional Swipe activity is useful for objects that may not be easily automated using the standard Swipe activity due to unconventiona; custom control implementation or an inaccessible web view.
When you configure a device, the Appium Url field now provides an inline error message stating that HTTPS is not supported.
Release date: April 26, 2021
Now you can configure the selectors in the Offline Edit mode.
The recorded actions have been repositioned and resized to improve the UX.
The action bar went through UI changes to achieve a more modern look.
The visual graphics for swiping when recording actions has been removed.
Mobile Device Manager provides support for native tablet applications however if the application has been initially developed for mobile, the support for the tablet versions is limited.
Release date: December 15, 2020
- Under specific circumstances, the Get Page Source activity returned a broken link.
- Targeting elements was not performed correctly in some cases, in the context of running two similar Android devices in Mobile Device Manager.
- In some cases, both native and web selectors were injected with an incorrect tag element.
- Changing the Studio language would scramble the location coordinates for Set Device Geolocation activities, due to the delimiter symbols being different for distinct languages, consequently, meddling with the location algorithm. This issue has now been addressed.
- Selector variables included in a While activity were available only once, during the first instance, making them unavailable for reuse.
Release date: October 13, 2020
Advanced debugging, including a timeline for executions and Appium calls, so you can have more control over your testing efforts.
Record on-screen interactions and import them directly in Studio to create mobile automation workflows.
You can now define variables to build dynamic values when you add devices and applications to Mobile Device Manager.
Switch between projects freely by importing or exporting your project, device, and application configurations.
Filtering is now available for your devices and applications.
A large pile of bugs has been swept under a big fix rug.
Release date: May 6, 2020
The new Mobile Automation activities pack offers you a suite of actions that make mobile testing very accessible. You can connect to either a local device or an Appium server, simulate all user interactions with a mobile device, as well as send and retrieve logs and information to and from the connected device.
- v24.10.3
- What's new
- Improvements
- v24.10.2
- v24.10.1
- v24.10.0
- What's new
- Improvements
- Bug fixes
- v23.10.5
- Bug fixes
- v23.10.4
- Bug fixes
- v23.10.3
- Bug fixes
- v23.10.2
- Bug fixes
- v23.10.1
- Bug fixes
- v23.4.3
- Bug fixes
- v22.10.6
- Bug fixes
- v23.10.0
- What's New
- Bug fixes
- Breaking change
- v23.4.2
- Bug fixes
- v22.10.5
- Bug fixes
- v22.4.6
- Bug fixes
- v21.10.7
- Bug fixes
- v23.4.1
- Improvements
- v22.10.4
- New features
- Improvements
- Bug fixes
- v23.4.0
- What's new
- Improvements
- Bug fixes
- v21.10.6
- Improvements
- v22.10.2
- New features
- Improvements
- v22.10.1
- Improvements
- Bug fixes
- v22.8.0
- Improvements
- v22.4.5
- Improvements
- v20.10.10
- Improvements
- v21.10.5
- Improvements
- v21.10.4
- Improvements
- v22.4.4
- Improvements
- v21.10.3
- Improvements
- v21.10.2
- Improvements
- v20.10.9
- Improvements
- v21.10.1
- Improvements
- v21.4.4
- Improvements
- v21.4.3
- Improvements
- v20.10.8
- Improvements
- v21.4.2
- Improvements
- Limitations
- Bug fixes
- v20.10.7
- Bug fixes
- v20.10.6
- Bug fixes
- v20.4.4
- Improvements
- v20.10.5
- New features and improvements
- v20.4.3
- Improvements
- v20.4.2
- Improvements
- v20.4.1
- New features and improvements
- Known issues
