- Overview
- UI Automation
- UI-ANA-016 - Pull Open Browser URL
- UI-ANA-017 - ContinueOnError True
- UI-ANA-018 - List OCR/Image Activities
- UI-DBP-006 - Container Usage
- UI-DBP-013 - Excel Automation Misuse
- UI-DBP-030 - Forbidden Variables Usage In Selectors
- ST-DBP-021 - Hardcoded Timeout
- UI-PRR-001 - Simulate Click
- UI-PRR-002 - Simulate Type
- UI-PRR-003 - Open Application Misuse
- UI-PRR-004 - Hardcoded Delays
- UI-REL-001 - Large Idx in Selectors
- UI-SEC-004 - Selector Email Data
- UI-SEC-010 - App/Url Restrictions
- UI-USG-011 - Non Allowed Attributes
- SY-USG-013 - Private File Invoke
- SY-USG-014 - Incorrect Execution Template Placeholders
- Applications and technologies automated with UI Automation
- UiPath Browser Migration Tool
- App/Web Recorder
- UI elements extraction
- Table Extraction
- Linux Robots
- UI Automation Browser Connection
- Computer Vision Recorder
- Click
- Hover
- Type Secure Text
- Send Hotkey
- Type Into
- Check
- Select Item
- Select Multiple Items
- Get Text
- Set Text
- Activate
- Highlight
- Set Focus
- Anchor Base
- Context Aware Anchor
- Find Relative Element
- Indicate On Screen
- Element Exists
- Find Element
- Wait Element Vanish
- Find Children
- Get Ancestor
- Element Scope
- Get Attribute
- Set Clipping Region
- Get Position
- Take Screenshot
- Wait Attribute
- On Element Appear
- On Element Vanish
- Click Text
- Hover Text
- Find Text Position
- Get Full Text
- Get Visible Text
- Extract Structured Data
- Text Exists
- Click OCR Text
- Hover OCR Text
- Get OCR Text
- Find OCR Text Position
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- Microsoft Azure Computer Vision OCR
- Tesseract OCR
- Google Cloud Vision OCR
- OCR Text Exists
- Click Image
- Hover Image
- Find Image Matches
- Image Exists
- Find Image
- Wait Image Vanish
- On Image Appear
- On Image Vanish
- Load Image
- Save Image
- Attach Browser
- Close Tab
- Go Back
- Go Forward
- Go Home
- Inject JS Script
- Navigate To
- Open Browser
- Refresh Browser
- Set Web Attribute
- Attach Window
- Close Window
- Get Active Window
- Hide Window
- Maximize Window
- Minimize Window
- Move Window
- Restore Window
- Show Window
- Export UI Tree
- Invoke ActiveX Method
- Inject .NET Code
- Click Trigger
- Key Press Trigger
- Click Image Trigger
- System Trigger
- Hotkey Trigger
- Mouse Trigger
- Get Event Info
- Monitor Events
- Get Source Element
- Replay User Event
- Block User Input
- Use Foreground
- Element Attribute Change Trigger
- Element State Change Trigger
- Callout
- Copy Selected Text
- Get From Clipboard
- Set To Clipboard
- Close Application
- Open Application
- Start Process
- Get Password
- Tooltip
- Click Picture on Screen
- Click Toolbar Button
- Read Statusbar
- Select Dates in Calendar
- Select Menu Item
- Expand Tree
- Call Transaction
- SAP Logon
- SAP Login
- Table Cell Scope
- SAP Session Attributes Change Trigger
- Expand ALV Tree
- Expand ALV Hierarchical Table
- Use Application/Browser
- Check App State
- Check/Uncheck
- Click
- Extract Table Data
- Get Text
- Get URL
- Go to URL
- Highlight
- Hover
- Keyboard Shortcuts
- Navigate Browser
- Select Item
- Take Screenshot
- Type Into
- Get Attribute
- Get Browser Data
- Set Browser Data
- Mouse Scroll
- Inject Js Script
- Drag and Drop
- For Each UI Element
- Application Event Trigger
- Click Event Trigger
- Keypress Event Trigger
- Set Text
- Check Element
- Fill Form
- Perform browser search and retrieve results using UI Automation APIs
- Web Browsing
- Find Images
- Click Images
- Trigger and Monitor Events
- Create and Override Files
- HTML Pages: Extract and Manipulate Information
- Window Manipulation
- Automated List Selection
- Find and Manipulate Window Elements
- Manage Text Automation
- Load and Process Images
- Manage Mouse Activated Actions
- Automate Application Runtime
- Automated Run of a Local Application
- Browser Navigation
- Web Automation
- Trigger Scope Example
- Computer Vision Local Server
- Mobile Automation
- Release notes
- Project compatibility
- Get Log Types
- Get Logs
- Get Page Source
- Get Device Orientation
- Get Session Identifier
- Install App
- Manage Current App
- Manage Other App
- Open DeepLink
- Open URL
- Mobile Device Connection
- Positional Swipe
- Press Hardware Button
- Set Device Orientation
- Take Screenshot
- Take Screenshot Part
- Element Exists
- Execute Command
- Get Attribute
- Get Selected Item
- Get Text
- Set Selected Item
- Set Text
- Swipe
- Tap
- Type Text
- Draw Pattern
- Terminal
UI Automation Browser Connection
The UI Automation Browser Connection capability helps the robot authenticate instead of the user, when the automation runs unattended, in the cloud, serverless.
This feature specifically addresses n-factor authentication automation scenarios. The most popular web enterprise business applications use n-factor authentication. Such an authentication mechanism requires the user to insert a security code, solve a captcha, or use a security token to complete the authentication, before accessing the application’s functional modules.
During a cloud automation execution, the user’s intervention to authenticate isn't possible and, even more, not recommended. Using the UI Automation Browser Connection capability, the robot resolves by itself the authentication process, based on the information provided when the automation was created, and it runs according to its schedule without requiring any user input.
To add a connection, follow the steps below:
- Click the Add activity button and add a Use Browser activity within your workflow.
- Select the drop-down menu from the Work in scope field and choose the tab you want to automate.
- Switch on the Requires Authentication toggle.
- Under the Connection field, select the plus button and then choose Add connection.
- Under Connection name, enter a unique name for your connection.
- (Optional) Under Connection description, write a description for your connection.
- The URL for sign in is automatically filled in based on your selection. Click Submit.
- You are now taken to the UI Automation Browser Connection screen where you need to sign in using your credentials.
- After successfully signing in, click the I'm done button. You are now taken back to your project where the new connection has been added.
This is how the entire process should look like:
To edit a connection, follow the steps below:
- Under the Connection field, select the plus button and then choose Edit connection.
- You are now taken to the UI Automation Browser Connection screen where you can reauthenticate if needed.
Besides using the UI Automation Browser Connection feature to authenticate, you can also use it to configure your browser.
Since the execution machine is always a new one, the browser is always in a fresh state and you might see certain popups at execution time causing your automation to fail.
So,you can use the feature to put the browser in the right state when building the workflow. Then, the robot makes sure the same state is set when starting the automation.
Azure Active Directory authentication
While using Azure Active Directory accounts for authentication, paired with the UI Automation Browser Connection feature, the automation runs repeatedly in a cloud environment. This might lead to the Active Directory server triggering identity protection mechanisms like asking the user to solve a captcha, or to change the account password.
To avoid this, we strongly suggest using dedicated service accounts specially configured for the robots.
Orchestrator shared folders
UI Automation Browser Connection cannot be used with Orchestrator shared folders, only with Orchestrator personal workspaces.
Application restrictions
The feature doesn’t work for web applications that delete the authentication cookies when the user closes the browser, thus mimicking a log out. For example, www.salesforce.com.
Studio Desktop
You cannot create or edit connections in Studio Desktop.
Server-based robots
platform
not supported
runtime exception.