- Overview
- Getting started
- Activities
- Insights dashboards
- Document Understanding Process
- Quickstart tutorials
- Framework components
- ML packages
- Overview
- Document Understanding - ML package
- DocumentClassifier - ML package
- ML packages with OCR capabilities
- 1040 - ML package
- 1040 Schedule C - ML package
- 1040 Schedule D - ML package
- 1040 Schedule E - ML package
- 1040x - ML package
- 3949a - ML package
- 4506T - ML package
- 709 - ML package
- 941x - ML package
- 9465 - ML package
- ACORD131 - ML package
- ACORD140 - ML package
- ACORD25 - ML package
- Bank Statements - ML package
- Bills Of Lading - ML package
- Certificate of Incorporation - ML package
- Certificate of Origin - ML package
- Checks - ML package
- Children Product Certificate - ML package
- CMS 1500 - ML package
- EU Declaration of Conformity - ML package
- Financial Statements - ML package
- FM1003 - ML package
- I9 - ML package
- ID Cards - ML package
- Invoices - ML package
- Invoices Australia - ML package
- Invoices China - ML package
- Invoices Hebrew - ML package
- Invoices India - ML package
- Invoices Japan - ML package
- Invoices Shipping - ML package
- Packing Lists - ML package
- Payslips - ML package
- Passports - ML package
- Purchase Orders - ML package
- Receipts - ML Package
- Remittance Advices - ML package
- UB04 - ML package
- Utility Bills - ML package
- Vehicle Titles - ML package
- W2 - ML package
- W9 - ML package
- Other Out-of-the-box ML Packages
- Public endpoints
- Traffic limitations
- OCR Configuration
- Pipelines
- OCR services
- Supported languages
- Deep Learning
- Licensing
Document Understanding User Guide
Forms AI
Forms AI is part of Document UnderstandingTM and can be used for uploading and processing structured forms with standard layouts and fields.
Forms AI is the first extraction method available in Document Understanding. Read more information about how to create a new project in Document Understanding.
Once a project is created, you need to follow the next steps for creating a document type using Forms AI within the project.
- Open your project.
- Select the New Document Type button.
- Add a name for your document type.
If you want to train your document classifiers straight from Document Understanding, than you can use the One Click Classification functionality.
You can convert a Forms AI Document Type into a Semi-Structured Document Type.
When you convert a Forms AI document type to a Semi-Structured (Document Manager) document type, you can use all the functionality available in Document Manager
The converting option is ideal for complex scenarios to train a more powerful Deep Learning Machine Learning Model.
There are two options you can choose from if you decided to convert a Forms AI session into a Document Manager session.
You can convert a Document Type straight from the project's Document Types list.
Access the Open access menu of the document type you want to convert and click the Convert to Semi-Structured option. A popup window is displayed asking you to confirm the action.
Once a Document Type has been converted, you cannot reverse the action.
Open an already created Forms AI session in order to convert it to a Semi-Structured session.
From the opened session click the Access menuthen click the Convert to Semi-Structured option.
The Convert to Semi-Structured button is not displayed if the project does not have an AI Center link.
Once the new Forms AI is created, a new window opens, requiring you to import data. You can import a minimum of two documents and a maximum of twenty documents, each with a maximum of five pages. Drag and drop or browse for the files to upload them.
Import documents is another way to convert from Forms AI to Semi-structured AI Document type. An option appears if you try to upload more than 20 documents, or if any of the documents has more than 20 pages. A popup is displayed on the screen, asking you if you want to convert the FormsAI session into a Semi-structured one.
Automatically extracted fields should also be checked for Content Type accuracy. For example, if a date field was automatically extracted, then the Content Type should be date. Any inaccuracies should be manually corrected.
At the top of the page you can find the management bar. The management bar enables you to perform multiple operations: navigate between documents, delete/restore a document, search/filter documents, run AI model predictions, import, and export documents.
Here are the items available in the management bar:
Item |
Icon |
Description |
---|---|---|
Navigation |
|
Navigate between documents that match the active filter. In between the two arrows, a counter is displayed. It illustrates the number of the current document out of the total number of documents that match the active search/filter. |
Search and Search in document |
|
Search - initiate a search or filter the documents. Filter is also applied when exporting documents. You can filter by words from a document or by document names. Search in document - initiate a text search inside the document by clicking on the or using the shortcut Ctrl + Shift + F |
Delete / Restore |
/ |
Delete or restore a document. Deleted documents can be found under the deleted filter. |
Import |
|
Open Import data dialog box. |
Export |
|
Open Export files dialog box. |
Document name and type |
n/a |
The name of the currently active document and its type. |
Download |
|
The option is available in the drop-down next to the document name. Click the icon to download a Zip file containing the original document. Besides the original document, all pages converted
internally by Document Manager to
.jpeg images are downloaded as well.
|
Permanently delete |
The option is available in the dropdown next to the document name. Permanently deletes individual files. The
.pdf and all its .jpeg images are deleted from the AI Center dataset and all the metadata is deleted from the database.
When clicking the button, a pop-up message appears asking you if you are sure you want to permanently delete the document. Click OK to continue or Cancel to revert to the previous screen. | |
Predict |
|
Run AI model predictions and display the results. After configuring Prelabelling, the button is enabled in the management bar. Click it to prelabel the current document. At the moment, using the Predict option with Public Endpoints prelabels only the first 10 pages of a document. This is a known issue and a fix is in the working. Using the Predict option with ML Skills in AI Center, however, does not impose such a limitation. |
Publish |
|
Publishes the Forms AI extractor and creates the associated link, available in the project's list of extractors. |
Settings |
|
Configure OCR and Prelabelling settings or access the How to... panel. The settings button has two available options:
|
Session |
n/a |
The name of the current session, found at the top of the page, next to the UiPath® Document UnderstandingTM logo. |
Let's go a little bit deeper in understanding the difference between Delete and Permanently Delete options.
- The Delete option deletes the files, without permanently removing them from your project. You can still find the deleted files under the deleted filter from the Search bar, and restore them by using the Restore option.
- The Permanently Delete option deletes the selected files without any possibility of restoring them.
The Settings button has two available options:
- Settings - where you can configure the OCR service
- How to... - which has the purpose of a help menu
- Click in the table section at the top of the page to add a new Column field. The Create Column Field window is displayed.
- Fill in a unique name for the field in the Enter unique field name field. The field does not accept uppercase letters. It can only contain lowercase letters, numbers, underscore
_
and dash-
. - Click OK.
Click the Edit field button. The available options for column fields can be found in the table below.
Option |
Description |
---|---|
Field name |
The unique name for the field. The field does not accept uppercase letters. It can only contain lowercase letters, numbers, underscore
_ and dash - .
|
Content type |
The content type of a field:
|
Shortcut |
The shortcut key for the field. One or two keys allowed. |
Split items |
Select this checkbox if you want this field to be used as a delimiter between line items or rows in a table. Any line on which this field appears is considered to be a new line item or row in the table. Most commonly, this is used on Line Amount fields on Invoice line items. |
Click Save to save your settings.
Grouping table rows is different than in the AI Center Document Manager. Here, the rows are automatically grouped based on the state of the Split items checkbox on each column fields. This is only relevant for tables with rows that contain multiple lines of text. In this case you must check the Split items checkbox on any of the fields that have only one line for each table row. For instance, on an invoice, the line item amount would be a typical field on which you might check the Split items option. In the context of Forms AI you would do the same thing on forms.
- Click on the right pane in the Fields section. The Create a new regular field window is displayed.
- Fill in a unique name for the field in the Enter unique field name field. The field does not accept uppercase letters. It can only contain lowercase letters, numbers, underscore
_
and dash-
. - Click OK.
- Click in the table section at the top of the page to delete all created fields. Use this function for deleting all fields, including Regular and Column fields, and all the labels on the documents in the current Document Type collection. This action cannot be undone.
- Click the Delete button from the Delete all fields dialog box.
Edit a field
Click the Edit field button. The available options for regular fields can be found in the table below.
Option |
Description |
---|---|
Field name |
The unique name for the field. The field does not accept uppercase letters. It can only contain lowercase letters, numbers, underscore
_ and dash - .
|
Content type |
The content type of a field:
|
Shortcut |
The shortcut key for the field. One or two keys allowed. |
Multi line |
General |
Click Save to save your settings.
Ctrl
+ mouse scroll.
You can label documents by selecting the word boxes and assigning them to a field by pressing a key. You can also right-click the word box and verify the extracted information.
For more details on how to label documents, visit this page.
Checkboxes that are available in Forms AI should be manually labelled for each field. Checkboxes from tables can also be labelled by using the Column Fields option. When a checkbox is labelled in Forms AI, both checked and unchecked boxes should be considered.
Here you can find more detailed information about how to label checkboxes.
You can choose to integrate your Document Understanding project into an RPA workflow by following the steps presented here.
- Create Forms AI
- Convert a Forms AI to a semi-structured document type
- How to convert a Forms AI session
- From the project's Document types list
- From an open Forms AI session
- Import documents
- Management bar
- Column fields
- Create a new column field
- Edit a column field
- Delete a column field
- Fields
- Create a new field
- Delete all fields
- Delete a regular field
- Document view and labelling
- Checkboxes