- Getting Started with Test Suite
- Studio
- Orchestrator
- Testing robots
- Test Manager
![](https://docs.uipath.com/_next/static/media/grid.05ebd128.png?w=3840&%3Bq=100)
Device interaction
When an action is executed, device interaction is locked until its completion.
To interact with your device you must first start an application. You have three options to choose from in MDM, as listed in the following table.
Method |
Procedure |
---|---|
Start an application from a device |
|
Start an application from a configured app |
|
Start an application using Quick Actions within the Welcome tab |
|
You can interact with your device in MDM as you would with an actual physical device, using your mouse or the action bar. The screen and the actions are locked when you perform an action.
The following table lists the on-screen actions that you can take to interact with your device.
Action |
Description |
Procedure |
---|---|---|
Tap |
Access an on-screen element. |
Click an element on the device screen. |
Double Tap |
Perform double tap action on-screen. |
Double-click an element on the device screen. |
Long Tap |
Long press. |
Click and hold on an element. |
Pinch (Zoom In/Out) |
Zoom in and out. This action is not recorded. |
Right-click and hold, and then drag to the bottom of the screen to zoom in, or towards the upper part to zoom out. |
Swipe |
Swipe on-screen. |
Click and drag towards any part of the screen. |
Keyboard Input |
Type in your text and send it to the mobile. For example, you can use the search bar to quickly access a website. |
|
The following table lists the actions that you can take to interact with your device. The action bar is right next to the device.
Action |
Description |
Procedure |
---|---|---|
iOS Home |
Return to the home screen. |
Click the iOS Home button. |
Android Back |
Get back to the previous screen/page. |
Click the Android Back button. |
Android Home |
Return to the home screen. |
Click the Android Home button. |
Android Switch Apps |
Switch between apps. |
Click the Android Switch Apps button, and choose your next action. |
Change orientation to landscape/portrait |
Toggle between portrait (vertical) and landscape (horizontal) mode for your device. Screen orientation is not supported by all applications. |
Click the Change Orientation toggle to switch between modes. |
Refresh |
Refresh the device connection. |
Click the Refresh button. Alternatively, click the Reconnect button when the connection has been lost. |
Save Screenshot |
Save the current screen. |
Click Save Screenshot and choose a location to save the file. |
Send Text |
Type in your text and send it to the mobile. For example, you can use the search bar to quickly access a website. |
|
Draw Pattern |
Draws whatever pattern on the device screen. Several points from the finger path are recorded and displayed on a X-Y axis. |
|
Selection by identified elements |
Selects UI elements that are identified by MDM. |
Click the Selection by identified elements to choose to select UI elements that are identified by MDM. |
Selection by absolute position |
Uses fixed element coordinates for selecting a UI element. The coordinates are recorded as a Positional Swipe activity. |
Click Selection by absolute position and choose the default coordinates for selecting a UI element. |
Record element action |
Records a manually configured action completed on certain UI elements. It is recommended for recording more granular actions, such as adding an offset to an on-screen tap. |
|
Toggle WebView selectors as native selectors |
Tries to convert future selectors of type WebView, to selectors of type native, in accordance with the operating system used. This feature makes automating web apps easier. |
|
Install App |
Install an application on your device. |
|
Manage App |
Manage the current application. |
|
Manage Other App |
Manage other applications on your device. You can use this when you test integrations between apps. |
|
Open URL |
Open URL in browser. |
|
Open Deep Link |
Launch an app that opens a specific page. |
|
Save Source |
Save the XML source file of the device. |
|
Set Geo Location |
Set geographic coordinates. |
|
The Record element action feature can be found inside the Action bar. This allows you to record highly granular actions, that can't be captured through a regular on-screen interaction. The Record element action feature works by recording an action that is completed on one, or more UI elements, and configuring it. The configuration of the action depends on the type of on-screen interaction that you choose. For example, if you choose Single Tap as your on-screen interaction, you can configurate into Double Tap or Long Tap.
The Record element action feature is recommended for recording more granular actions, such as adding an offset to an on-screen tap.
To use the Record element action feature:
- Click Record element action
.
- Select a UI element on the device’s screen.
-
Click Single tap
, and choose a type of on-screen interaction from the drop-down list. For example, choose Single tap.
- Click Configure Action
to further configure the action, for more granularity.
- Click Execute Action
to run the action that you’ve just recorded, in the Recorded Actions panel.
The WebView selectors as native selectors feature can be found inside the Action bar. When toggled, it tries to convert all future selectors from WebView to Native. This allows a better, faster, and more familiar interaction with UI elements inside web views.
You can interact with your device through the action bar or by indicating your actions on-screen to record the steps. For example, you can record and manage your actions to prepare mobile automation workflows in MDM. For more information, see Create Workflow Using Recorded Actions.
The following table lists the actions that you can take using Recorded Actions.
Action |
Description |
Procedure |
---|---|---|
Execute |
Execute the action. |
Click the Play button on an action to execute it. |
Copy |
Copy the action to your clipboard. You can use the Import Recorded Actions in Studio to paste it to your workflow. |
Click the Copy button to copy the action to your clipboard. |
Delete |
Delete the action. |
Click Delete to remove the action from the list. Alternatively, you can click Clear All to remove all actions. |
Reorder |
Reorder the list of actions in alternate order. |
Drag and drop an action to different position within the list. |
Wait for page update |
Wait for the page source to retrieve a screenshot of each action. |
Toggle the Wait for new screenshot after each action. |