Digitization Overview

What Is Digitization

Digitization is the process of obtaining machine readable text from a given incoming file, so that a robot can then understand its contents and act upon them. It is the first step applied on files that need to be processed through the Document Understanding framework.

The digitization step has two outputs:

• the text from the processed file, stored in a string variable, and
• the Document Object Model of that file - JSON object containing basic information such as name, content type, text length, the number of pages, as well as detailed information such as page rotation, detected language, content and coordinates for every word identified in the file.

In the Document Processing Framework, digitization is performed using the Digitize Document activity.

What Digitization Is Not

Even though related, the digitization step is not OCR.

In many cases, the files that need to be processed are native PDF files (not scanned), that can be read programmatically by the robot without applying OCR.

When Is OCR Used in Digitization

The Digitize Document activity requires, as part of its configuration, the selection of an OCR engine - so that, at need, it can be used, but only executes OCR on

• files that are images
  • supported images formats are .png, .gif, .jpe, .jpg, .jpeg, .tiff, .tif, .bmp
  • for multi-page TIFF files, OCR is applied for each page
• PDF pages that
  • do not expose any machine readable content
  • contain images that cover a significant area of the page.

OCR is also applied, always, if the Digitize Document activity is configured with the ForceApplyOCR flag set to True. This option is usually recommended for use cases in which a significant percentage of files seem to contain native content, but the natively read content does not correspond to what a user can see in those files.

How to Choose Your OCR Engine

As each use case has its own particularities, it is strongly recommended to test all available OCR Engines with different settings, in order to determine which one works best for your project. Another recommendation is to pay particular attention to the OCR engine arguments, such as Profile,Scale,Language etc. (may vary from one engine to another), so that you identify the best settings for each use case.