activities
latest
false
UiPath logo, featuring letters U and I in white

UI Automation Activities

Last updated Mar 13, 2025

About the Mobile Automation activity package

The Mobile Automation Activities package contains tools that makes creating automation for mobile devices easier. With our new Mobile Device Manager, you can configure devices and apps, connect to them, and interact with them, without ever touching the devices. We support iOS and Android, locally, in the network or in the cloud, no matter if they are real devices or emulators. The package guarantees that mixing desktop and mobile automation is easier than ever, by having the same look and feel.

To create automated mobile tests, choose one of the following experiences:

Set up Mobile Automation package

To use the mobile automation tools to their full extent, to design and run the workflows, download the following activity packages:

  • UiPath.Mobile.Automation.Activities - used for designing workflows.
  • UiPath.Mobile.Automation.Activities.Runtime - used for running workflows.

Selection options

Mobile Automation activities allow you to work with mobile UI elements by simulating human interaction. When you select Indicate Target inside the body of a mobile automation activity, a separate Selection Options panel opens, enabling you to simulate the interaction with the device.

Accessing the Selection Options panel

To open the Selection Options panel, select Indicate Target inside the body of the activity. This action takes you back to Mobile Device Manager next to where it opens the Selection Options panel.



Working with Selection Options

In the Selection Options panel you can choose to indicate a UI element using various selector generation methods. The table below describes each selector generation method and their corresponding keyboard shortcut that you use to enable them.
Note: Mobile automation selectors don't support wildcard characters.
MethodDescriptionHow to use the method
Context aware elements discoverySelects UI elements that are identified by Mobile Device Manager. Select F2 in the selection panel, or press F2 on your keyboard.
Image selection modeSelects UI elements based on an image that you manually crop from the mobile screen in MDM. Select F3 in the selection panel, or press F3 on your keyboard.
WebView selectors as native selectorsTries to convert future selectors of type WebView, to selectors of type native, in accordance with the operating system used. This feature makes automating web apps easier. Select F4 in the selection panel, or press F4 on your keyboard.
Computer VisionSelects UI elements identified by the Computer Vision feature. This feature uses a UiPath neural network that is able to identify UI elements without the use of selectors. This method, in turn, manages to identify elements that are otherwise unable to automate.

To access a preview of all the elements that Computer Vision can identify and automate, press the icon next to it.

Select F5 in the selection panel, or press F5 on your keyboard to enable the selector generation method.

Was this page helpful?

Get The Help You Need
Learning RPA - Automation Courses
UiPath Community Forum
Uipath Logo White
© 2005-2025 UiPath. All rights reserved.