- 概述
- 用户界面自动化
- 关于“用户界面自动化”活动包
- 通过用户界面自动化实现自动化的应用程序和技术
- 项目兼容性
- UI-ANA-016 - 拉取打开浏览器 URL
- UI-ANA-017 - 出错时继续 True
- UI-ANA-018 - 列出 OCR/图像活动
- UI-DBP-006 - 容器使用情况
- UI-DBP-013 - Excel 自动化误用
- UI-DBP-030 - 选取器中的禁止变量使用情况
- UI-DBP-031 - 活动验证
- UI-PRR-001 - 模拟单击
- UI-PRR-002 - 模拟键入
- UI-PRR-003 - 打开应用程序误用
- UI-PRR-004 - 硬编码延迟
- UI-REL-001 - 选取器中的大 IDX
- UI-SEC-004 - 选取器电子邮件数据
- UI-SEC-010 - 应用程序/Url 限制
- UI-USG-011 - 不允许的属性
- UX-SEC-010 - 应用程序/Url 限制
- UX-DBP-029 - 使用不安全的密码
- UI-PST-001 - 项目设置中的审核日志级别
- UiPath 浏览器迁移工具
- 剪切区域
- 计算机视觉录制器
- 活动索引
- 激活
- 锚点基准
- 附加浏览器
- 附加窗口
- 阻止用户输入
- 标注
- 选中
- 单击
- 单击图像
- 单击图像触发器
- 单击 OCR 文本
- 单击文本
- 单击触发器
- 关闭应用程序
- 关闭选项卡
- 关闭窗口
- 上下文感知锚点
- 复制选定文本
- 元素属性更改触发器
- 存在元素
- 元素作用域
- 元素状态更改触发器
- 导出用户界面树
- 提取结构化数据
- 查找子元素
- 查找元素
- 查找图像
- 查找图像匹配项
- 查找 OCR 文本位置
- 查找相对元素
- 查找文本位置
- 获取活动窗口
- 获取上级
- 获取属性
- 获取事件信息
- 从剪贴板获取
- 获取全文
- 获取 OCR 文本
- 获取密码
- 获取位置
- 获取源元素
- 获取文本
- 获取可见文本
- 返回
- 前往
- 转至主页
- Google Cloud Vision OCR
- 隐藏窗口
- 高亮显示
- 热键触发器
- 悬停
- 悬停在图像上方
- 悬停在 OCR 文本上方
- 悬停文本
- 存在图像
- 在屏幕上指定
- 注入 .NET 代码
- 插入 Js 脚本
- 调用 ActiveX 方法
- 按键触发器
- 加载图像
- 最大化窗口
- Microsoft Azure 计算机视觉 OCR
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- 最小化窗口
- 监控事件
- 鼠标触发器
- 移动窗口
- 导航至
- 存在 OCR 文本
- 在元素出现时
- 在元素消失时
- 在图像出现时
- 在图像消失时
- 打开应用程序
- 打开浏览器
- 刷新浏览器
- 重播用户事件
- 还原窗口
- 保存图像
- 选择项目
- 选择多个项目
- 发送热键
- 设置剪切区域
- 设置焦点
- 设置文本
- 设置为剪贴板
- 设置网页属性
- 显示窗口
- 启动进程
- 系统触发器
- 截取屏幕截图
- Tesseract OCR
- 存在文本
- 工具提示
- 键入
- 输入安全文本
- 使用前台
- 等待属性
- 等待元素消失
- 等待图像消失
- Computer Vision Local Server
- 移动自动化
- 终端

用户界面自动化活动
打开
打开要在用户界面自动化中使用的桌面应用程序或网页浏览器页面。
通过根据以下格式调用 UIAutomation 服务来使用此 API: uiAutomation.API() 。 例如uiAutomation.Open() 。
定义
命名空间:UiPath.UIAutomationNext.API.Contracts
程序集:UiPath.UIAutomationNext.API.Contracts(在 UiPath.UIAutomationNext.API.Contracts dll 中)
重载
| 重载 | 描述 |
|---|---|
Open(String, TargetAppOptions, String, String) | 打开要在用户界面自动化中使用的特定桌面应用程序或网页,由对象存储库中的屏幕名称标识。 |
Open(TargetAppModel, TargetAppOptions) | 打开要在用户界面自动化中使用的特定桌面应用程序或网页,由 TargetAppModel 对象标识。 |
Open(String, String, String, NAppOpenMode, NWindowResize, NInteractionMode) | 打开要在用户界面自动化中使用的特定桌面应用程序或网页,由对象存储库中的屏幕名称以及应用程序或网页的其他自定义项标识。 |
Open(String, TargetAppOptions, String, String)
打开要在用户界面自动化中使用的特定桌面应用程序或网页,由对象存储库中的屏幕名称标识。
Open(
string screenName,
TargetAppOptions targetAppOptions,
[string appName],
[string appVersion])
Open(
string screenName,
TargetAppOptions targetAppOptions,
[string appName],
[string appVersion])
screeName String :要关注的屏幕的名称,以字符串形式记录在对象存储库中。
targetAppOptions :用于附加到应用程序或网页的其他选项和设置:
* `Timeout Double` - Specify a number
of seconds for which to wait for the activity to be executed before
throwing an error. The default value is 30 seconds. When indicating
a window in a Remote Desktop environment, the Timeout default
setting is set to 60 seconds.
* `InteractionMode
NInteractionMode`:
+ `HardwareEvents` - Uses the hardware
driver to perform the action. This is the slowest API, it
cannot work in the background, but it is compatible with all
desktop apps.
+ `Simulate` - Simulates the action using
accessibility APIs. Recommended in browser automation, Java
apps, or SAP. More reliable than Hardware Events. Sends all
text in a single action. Works even if the target
application is not in focus. Please test if your target
application UI element supports this.
+ `DebuggerApi` - Performs actions using
debugger APIs. Works only for Chromium elements. Sends all
text in one go. Works even if target app is not in focus.
For more details, check out this [page](https://docs.uipath.com/studio/docs/chromium-api).
+ `WindowMessages` - Sends the mouse and
keyboard input through Win32 messages. Recommended for
desktop apps. Usually more reliable than Hardware Events.
Sends all text in a single action. Works even if target app
is not in focus. Please test if your target application UI
element supports this.
+ `Background` - Runs actions in the
background. Tries to use either Simulate or Chromium API
where possible, while complex APIs (image, native text)
run as usual, in the foreground. It is highly recommended to
use this API with the [Verify Execution](https://docs.uipath.com/activities/other/latest/user-guide/project-settings-ui-automation)
feature.
* `OpenMode NAppOpenMode` - choose when
to open the app:
+ `Never` (never open the
application)
+ `IfNotOpen` (open only if the
application is closed, this is the default selection, only
works if `FilePath` or `URL`
are provided)
+ `Always` (open another instance of the
application even if one is already open, only works if
`FilePath` or `URL` are
provided)
* `WindowResize NWindowResize` - choose
the size of the window:
+ `None`
+ `Maximize`
+ `Restore`
+ `Minimize`
* `UserDataFolderMode
BrowserUserDataFolderMode` - The
`UserDataFolderMode` you want to set. It is used
to start the browser with a specific user data folder.
+ `Automatic` - Picture In Picture mode
uses a different folder than the default mode, automatically
generated if `UserDataFolderPath` is not
set.
+ `DefaultFolder` - Uses the default
browser folder, no matter if it runs in the main or PIP
session.
+ `CustomFolder` - Uses the folder
specified in `UserDataFolderPath` or an auto
generated path if `UserDataFolderPath` is not
set.
* `UserDataFolderPath String` - The
user data folder that the browser uses. Defaults to
`%LocalAppData%\UiPath\PIP Browser
Profiles\BrowserType` if not set.
* `IsIncognito Boolean` - input
`True` if you want to open the browser in
incognito mode. By default it's set to `False`.
* `WebDriverMode NWebDriverMode` -
Indicates how the WebDriver is used when opening a new browser
session. The following options are available:
+ `Disabled` - Disables the use of
WebDriver.
+ `WithGUI` - The GUI of the browser is
displayed.
+ `Headless` - The browser is launched
silently, with no GUI.
* `Timeout Double` - Specify a number
of seconds for which to wait for the activity to be executed before
throwing an error. The default value is 30 seconds. When indicating
a window in a Remote Desktop environment, the Timeout default
setting is set to 60 seconds.
* `InteractionMode
NInteractionMode`:
+ `HardwareEvents` - Uses the hardware
driver to perform the action. This is the slowest API, it
cannot work in the background, but it is compatible with all
desktop apps.
+ `Simulate` - Simulates the action using
accessibility APIs. Recommended in browser automation, Java
apps, or SAP. More reliable than Hardware Events. Sends all
text in a single action. Works even if the target
application is not in focus. Please test if your target
application UI element supports this.
+ `DebuggerApi` - Performs actions using
debugger APIs. Works only for Chromium elements. Sends all
text in one go. Works even if target app is not in focus.
For more details, check out this [page](https://docs.uipath.com/zh-CN/studio/docs/chromium-api).
+ `WindowMessages` - Sends the mouse and
keyboard input through Win32 messages. Recommended for
desktop apps. Usually more reliable than Hardware Events.
Sends all text in a single action. Works even if target app
is not in focus. Please test if your target application UI
element supports this.
+ `Background` - Runs actions in the
background. Tries to use either Simulate or Chromium API
where possible, while complex APIs (image, native text)
run as usual, in the foreground. It is highly recommended to
use this API with the [Verify Execution](https://docs.uipath.com/zh-CN/activities/other/latest/user-guide/project-settings-ui-automation)
feature.
* `OpenMode NAppOpenMode` - choose when
to open the app:
+ `Never` (never open the
application)
+ `IfNotOpen` (open only if the
application is closed, this is the default selection, only
works if `FilePath` or `URL`
are provided)
+ `Always` (open another instance of the
application even if one is already open, only works if
`FilePath` or `URL` are
provided)
* `WindowResize NWindowResize` - choose
the size of the window:
+ `None`
+ `Maximize`
+ `Restore`
+ `Minimize`
* `UserDataFolderMode
BrowserUserDataFolderMode` - The
`UserDataFolderMode` you want to set. It is used
to start the browser with a specific user data folder.
+ `Automatic` - Picture In Picture mode
uses a different folder than the default mode, automatically
generated if `UserDataFolderPath` is not
set.
+ `DefaultFolder` - Uses the default
browser folder, no matter if it runs in the main or PIP
session.
+ `CustomFolder` - Uses the folder
specified in `UserDataFolderPath` or an auto
generated path if `UserDataFolderPath` is not
set.
* `UserDataFolderPath String` - The
user data folder that the browser uses. Defaults to
`%LocalAppData%\UiPath\PIP Browser
Profiles\BrowserType` if not set.
* `IsIncognito Boolean` - input
`True` if you want to open the browser in
incognito mode. By default it's set to `False`.
* `WebDriverMode NWebDriverMode` -
Indicates how the WebDriver is used when opening a new browser
session. The following options are available:
+ `Disabled` - Disables the use of
WebDriver.
+ `WithGUI` - The GUI of the browser is
displayed.
+ `Headless` - The browser is launched
silently, with no GUI.
appName String : 要附加到的应用程序的名称。此参数适用于桌面应用程序。
appVersion String : 要附加到的应用程序的版本。此参数适用于桌面应用程序。
Open(TargetAppModel, TargetAppOptions)
打开要在用户界面自动化中使用的特定桌面应用程序或网页,由 TargetAppModel 对象标识。
Open(
TargetAppModel targetApp,
[TargetAppOptions targetAppOptions])
Open(
TargetAppModel targetApp,
[TargetAppOptions targetAppOptions])
targetApp TargetAppModel :要附加到的目标应用程序或网页。它是TargetAppModel类型的对象,提供有关应用程序的信息:
* `Selector` - An XML fragment that stores the
attributes of a user interface element.
* `FilePath` - If the application is not a web
browser, specifies the full path of the executable file to
open.
* `Arguments` - If the application is not a web
browser, you can specify parameters to pass to the target
application at startup.
* `Url`
- If the application is a web browser, specifies the URL of the web
page to open.
* `Title` - The title of the application or
browser.
* `Selector` - An XML fragment that stores the
attributes of a user interface element.
* `FilePath` - If the application is not a web
browser, specifies the full path of the executable file to
open.
* `Arguments` - If the application is not a web
browser, you can specify parameters to pass to the target
application at startup.
* `Url`
- If the application is a web browser, specifies the URL of the web
page to open.
* `Title` - The title of the application or
browser.
targetAppOptions :用于附加到应用程序或网页的其他选项和设置:
* `Timeout Double` - Specify a number of seconds
for which to wait for the activity to be executed before throwing an
error. The default value is 30 seconds. When indicating a window in
a Remote Desktop environment, the Timeout default setting is set to
60 seconds.
* `InteractionMode NInteractionMode`:
+ `HardwareEvents` - Uses the hardware driver
to perform the action. This is the slowest API, it cannot
work in the background, but it is compatible with all
desktop apps.
+ `Simulate` - Simulates the action using
accessibility APIs. Recommended in browser automation, Java
apps, or SAP. More reliable than Hardware Events. Sends all
text in a single action. Works even if the target
application is not in focus. Please test if your target
application UI element supports this.
+ `DebuggerApi` - Performs actions using
debugger APIs. Works only for Chromium elements. Sends all
text in one go. Works even if target app is not in focus.
For more details, check out this [page](https://docs.uipath.com/studio/docs/chromium-api).
+ `WindowMessages` - Sends the mouse and
keyboard input through Win32 messages. Recommended for
desktop apps. Usually more reliable than Hardware Events.
Sends all text in a single action. Works even if target app
is not in focus. Please test if your target application UI
element supports this.
+ `Background` - Runs actions in the
background. Tries to use either Simulate or Chromium API
where possible, while complex APIs (image, native text)
run as usual, in the foreground. It is highly recommended to
use this API with the [Verify Execution](https://docs.uipath.com/activities/other/latest/user-guide/project-settings-ui-automation)
feature.
* `OpenMode NAppOpenMode` - choose when to open
the app:
+ `Never` (never open the application)
+ `IfNotOpen` (open only if the application is
closed, this is the default selection, only works if
`FilePath` or `URL` are
provided)
+ `Always` (open another instance of the
application even if one is already open, only works if
`FilePath` or `URL` are
provided)
* `WindowResize NWindowResize` - choose the size
of the window:
+ `None`
+ `Maximize`
+ `Restore`
+ `Minimize`
* `UserDataFolderMode BrowserUserDataFolderMode`
- The `UserDataFolderMode` you want to set. It is
used to start the browser with a specific user data folder.
+ `Automatic` - Picture In Picture mode uses a
different folder than the default mode, automatically
generated if `UserDataFolderPath` is not
set.
+ `DefaultFolder` - Uses the default browser
folder, no matter if it runs in the main or PIP
session.
+ `CustomFolder` - Uses the folder specified in
`UserDataFolderPath` or an auto generated
path if `UserDataFolderPath` is not set.
* `UserDataFolderPath String` - The user data
folder that the browser uses. Defaults to
`%LocalAppData%\UiPath\PIP Browser
Profiles\BrowserType` if not set.
* `IsIncognito Boolean` - input
`True` if you want to open the browser in
incognito mode. By default it's set to `False`.
* `WebDriverMode NWebDriverMode` - Indicates how
the WebDriver is used when opening a new browser session. The
following options are available:
+ `Disabled` - Disables the use of
WebDriver.
+ `WithGUI` - The GUI of the browser is
displayed.
+ `Headless` - The browser is launched
silently, with no GUI.
* `Timeout Double` - Specify a number of seconds
for which to wait for the activity to be executed before throwing an
error. The default value is 30 seconds. When indicating a window in
a Remote Desktop environment, the Timeout default setting is set to
60 seconds.
* `InteractionMode NInteractionMode`:
+ `HardwareEvents` - Uses the hardware driver
to perform the action. This is the slowest API, it cannot
work in the background, but it is compatible with all
desktop apps.
+ `Simulate` - Simulates the action using
accessibility APIs. Recommended in browser automation, Java
apps, or SAP. More reliable than Hardware Events. Sends all
text in a single action. Works even if the target
application is not in focus. Please test if your target
application UI element supports this.
+ `DebuggerApi` - Performs actions using
debugger APIs. Works only for Chromium elements. Sends all
text in one go. Works even if target app is not in focus.
For more details, check out this [page](https://docs.uipath.com/zh-CN/studio/docs/chromium-api).
+ `WindowMessages` - Sends the mouse and
keyboard input through Win32 messages. Recommended for
desktop apps. Usually more reliable than Hardware Events.
Sends all text in a single action. Works even if target app
is not in focus. Please test if your target application UI
element supports this.
+ `Background` - Runs actions in the
background. Tries to use either Simulate or Chromium API
where possible, while complex APIs (image, native text)
run as usual, in the foreground. It is highly recommended to
use this API with the [Verify Execution](https://docs.uipath.com/zh-CN/activities/other/latest/user-guide/project-settings-ui-automation)
feature.
* `OpenMode NAppOpenMode` - choose when to open
the app:
+ `Never` (never open the application)
+ `IfNotOpen` (open only if the application is
closed, this is the default selection, only works if
`FilePath` or `URL` are
provided)
+ `Always` (open another instance of the
application even if one is already open, only works if
`FilePath` or `URL` are
provided)
* `WindowResize NWindowResize` - choose the size
of the window:
+ `None`
+ `Maximize`
+ `Restore`
+ `Minimize`
* `UserDataFolderMode BrowserUserDataFolderMode`
- The `UserDataFolderMode` you want to set. It is
used to start the browser with a specific user data folder.
+ `Automatic` - Picture In Picture mode uses a
different folder than the default mode, automatically
generated if `UserDataFolderPath` is not
set.
+ `DefaultFolder` - Uses the default browser
folder, no matter if it runs in the main or PIP
session.
+ `CustomFolder` - Uses the folder specified in
`UserDataFolderPath` or an auto generated
path if `UserDataFolderPath` is not set.
* `UserDataFolderPath String` - The user data
folder that the browser uses. Defaults to
`%LocalAppData%\UiPath\PIP Browser
Profiles\BrowserType` if not set.
* `IsIncognito Boolean` - input
`True` if you want to open the browser in
incognito mode. By default it's set to `False`.
* `WebDriverMode NWebDriverMode` - Indicates how
the WebDriver is used when opening a new browser session. The
following options are available:
+ `Disabled` - Disables the use of
WebDriver.
+ `WithGUI` - The GUI of the browser is
displayed.
+ `Headless` - The browser is launched
silently, with no GUI.
Open(String, String, String, NAppOpenMode, NWindowResize, NInteractionMode)
打开要在用户界面自动化中使用的特定桌面应用程序或网页,由对象存储库中的屏幕名称以及应用程序或网页的其他自定义项标识。
Open(
string screenName,
[string appName],
[string appVersion],
[NAppOpenMode openMode],
[NWindowResize windowResize],
[NInteractionMode interactionMode])
Open(
string screenName,
[string appName],
[string appVersion],
[NAppOpenMode openMode],
[NWindowResize windowResize],
[NInteractionMode interactionMode])
screeName String :要关注的屏幕的名称,以字符串形式记录在对象存储库中。
appName String : 要附加到的应用程序的名称。此参数适用于桌面应用程序。
appVersion String : 要附加到的应用程序的版本。此参数适用于桌面应用程序。
openMode NAppOpenMode :选择打开目标应用程序以执行自动化的时间:
* `Never` (never open the application)
* `IfNotOpen` (open only if the application is closed,
this is the default selection, only works if the
`Url` parameter is configured)
* `Always` - (open another instance of the application
even if one is already open, only works if the `Url`
parameter is configured).
* `Never` (never open the application)
* `IfNotOpen` (open only if the application is closed,
this is the default selection, only works if the
`Url` parameter is configured)
* `Always` - (open another instance of the application
even if one is already open, only works if the `Url`
parameter is configured).
NWindowResize :选择窗口的大小:
* `None`
* `Maximize`
* `Restore`
* `Minimize`
* `None`
* `Maximize`
* `Restore`
* `Minimize`
NInteractionMode :选择机器人应用于与目标应用程序交互的 API:
* `HardwareEvents` - Uses the hardware driver to
perform the action. This is the slowest API, it cannot work in
the background, but it is compatible with all desktop apps.
* `Simulate` - Simulates the action using accessibility
APIs. Recommended in browser automation, Java apps, or SAP. More
reliable than Hardware Events. Sends all text in a single action.
Works even if the target application is not in focus. Please test if
your target application UI element supports this.
* `DebuggerApi` - Performs actions using debugger APIs.
Works only for Chromium elements. Sends all text in one go. Works
even if target app is not in focus. For more details, check out this
[page](https://docs.uipath.com/studio/docs/chromium-api).
* `WindowMessages` - Sends the mouse and keyboard input
through Win32 messages. Recommended for desktop apps. Usually more
reliable than Hardware Events. Sends all text in a single action.
Works even if target app is not in focus. Please test if your target
application UI element supports this.
* `Background` - Runs actions in the background. Tries
to use either Simulate or Chromium API where possible, while complex
APIs (image, native text) run as usual, in the foreground. It is
highly recommended to use this API with the [Verify Execution](https://docs.uipath.com/activities/other/latest/user-guide/project-settings-ui-automation)
feature.
* `HardwareEvents` - Uses the hardware driver to
perform the action. This is the slowest API, it cannot work in
the background, but it is compatible with all desktop apps.
* `Simulate` - Simulates the action using accessibility
APIs. Recommended in browser automation, Java apps, or SAP. More
reliable than Hardware Events. Sends all text in a single action.
Works even if the target application is not in focus. Please test if
your target application UI element supports this.
* `DebuggerApi` - Performs actions using debugger APIs.
Works only for Chromium elements. Sends all text in one go. Works
even if target app is not in focus. For more details, check out this
[page](https://docs.uipath.com/zh-CN/studio/docs/chromium-api).
* `WindowMessages` - Sends the mouse and keyboard input
through Win32 messages. Recommended for desktop apps. Usually more
reliable than Hardware Events. Sends all text in a single action.
Works even if target app is not in focus. Please test if your target
application UI element supports this.
* `Background` - Runs actions in the background. Tries
to use either Simulate or Chromium API where possible, while complex
APIs (image, native text) run as usual, in the foreground. It is
highly recommended to use this API with the [Verify Execution](https://docs.uipath.com/zh-CN/activities/other/latest/user-guide/project-settings-ui-automation)
feature.
以无头模式运行网页驱动程序模式
要在无头配置中操作网页驱动程序模式,这些步骤可以用作指南。
首先为屏幕定义变量。使用函数 uiAutomation.Open 在您选择的浏览器中打开一个新应用程序 - 在本例中为 Edge。之后,在重载中使用 Options 类来指定某些浏览器选项。在这些选项中,将 webDriverMode 设置为 NWebDriverMode.Headless。
相应的代码如下所示:
var screen = uiAutomation.Open(Descriptors.NewApplication.Edge, Options.AppOpen().WithBrowserOptions(webDriverMode: NWebDriverMode.Headless));
var screen = uiAutomation.Open(Descriptors.NewApplication.Edge, Options.AppOpen().WithBrowserOptions(webDriverMode: NWebDriverMode.Headless));
此代码用于将网页驱动程序设置为无头模式,从而在无需看到打开浏览器的情况下启用浏览器自动化。