- Overview
- About Document Understanding™
- Introduction
- Document types
- Fundamental capabilities
- Key concepts
- Building models
- Consuming models
- ML packages
- 1040 - ML package
- 1040 Schedule C - ML package
- 1040 Schedule D - ML package
- 1040 Schedule E - ML package
- 1040x - ML package
- 3949a - ML package
- 4506T - ML package
- 709 - ML package
- 941x - ML package
- 9465 - ML package
- ACORD131 - ML package
- ACORD140 - ML package
- ACORD25 - ML package
- Bank Statements - ML package
- Bills Of Lading - ML package
- Certificate of Incorporation - ML package
- Certificate of Origin - ML package
- Checks - ML package
- Children Product Certificate - ML package
- CMS 1500 - ML package
- EU Declaration of Conformity - ML package
- Financial Statements - ML package
- FM1003 - ML package
- I9 - ML package
- ID Cards - ML package
- Invoices - ML package
- Invoices Australia - ML package
- Invoices China - ML package
- Invoices Hebrew - ML package
- Invoices India - ML package
- Invoices Japan - ML package
- Invoices Shipping - ML package
- Packing Lists - ML package
- Payslips - ML package
- Passports - ML package
- Purchase Orders - ML package
- Receipts - ML Package
- Remittance Advices - ML package
- UB04 - ML package
- Utility Bills - ML package
- Vehicle Titles - ML package
- W2 - ML package
- W9 - ML package
- Public endpoints
- Supported languages
- Data and security
- Licensing and Charging Logic
- How to
Fundamental capabilities
To automate document processing, four fundamental capabilities are required: digitization, classification, extraction, and validation.
Digitization converts a physical document into machine-readable text, which can then be processed digitally. Although Optical Character Recognition (OCR) is a significant part of digitization, the digitization process is more complex and involves various steps, including OCR.
For example, when dealing with PDF documents, the digitization algorithm can distinguish between scanned and native PDFs or hybrid ones that contain scanned images and native text. Most of the text can be extracted directly from a native PDF document, but in some cases, a few logos may need to be read using OCR. The digitization process can handle all of these situations to ensure maximum accuracy in text detection while running quickly and efficiently.
In most use cases, documents need to be sorted into logical categories so different processing methods can be applied to them.
The objective of a classification is to scan a document and decide what document type it belongs to. Knowing the type of a document is important, as different document types require different processing techniques. For example, an invoice needs to be processed by an invoice extraction model to ensure all relevant fields get extracted.
Data extraction is the process of selecting and retrieving only the relevant information from a document. Extracting specific data from a lengthy document using string manipulation can be challenging. However, Document UnderstandingTM provides various extraction methodologies for different document types and formats. For example, we only want to extract the Vendor Name, Billing Name, Due Date, and Total fields from an invoice.
In classification and extraction, software robots use the concept of confidence, which measures the level of certainty that a particular task was performed well. The task can either be recognizing a document type, identifying a field, or reading the data in it. In these cases, the Document Understanding framework allows you to engage a human user to review and validate the robot's output. In the best scenario, the human input is used to train the robot's accuracy through machine learning.
