Loading data using DataUploader

With DataUploader you can upload data files up to 5TB each directly into a Process Mining process app. Loading data using DataUploader is more stable than loading data using the Upload data option in Process Mining, also for smaller data files. If the upload using DataUploader fails, for example, due to an unstable connection, DataUploader will retry the upload up to 4 times.

Note:

Always make sure that the data is in the required format for the app template used for the process app. See App Templates.

Downloading DataUploader

Use the following link to download DataUploader: https://download.uipath.com/ProcessMining/versions/1.0.0/DataUploader/process-mining-data-uploader.exe.

Parameters

Below is an overview of the parameters for DataUploader.

Parameter	Format	Description	Mandatory Y/N	Example
-c --csv-dir	<csv dir value>	The directory containing the CSV files you want to upload. Note: This can also be a relative path.	Y	C:\P2P data
-s --sas-url	<sas url value>	The Shared Access Signature (SAS) URL for the Azure Blob Storage container where the files need to be uploaded. See Retrieving the credentials for the Azure blob storage	Y
-e --end-of-upload-api	<value>	URL to the end-of-upload-API that will be called when the files have been successfully uploaded. See Retrieving the credentials for the Azure blob storage	Y
-d --delimiter	<delimiter value>	The ASII code of the delimiter used in the input files. Note: This must be an ascii value between 0 and 127. Default is 9 (Tab).	N	44 (= Comma) 9 (= Tab)
-p --proxy	<proxy value>	The proxy URL	N
-u --proxy-username	<proxy username>	The username if authentication is needed to connect to proxy server.	N
-P --proxy-password	<proxy password>	The password if authentication is needed to connect to proxy server.	N
-r --recursive		Look for all files in the given folder including sub-folders. Attention: If files with duplicate names are present in different folders, the behavior can be unpredictable. Note: By default, only files in the given folder are uploaded and sub-folders are ignored.
-f --config-file	<config file value>	Allows you to use a configuration file instead of inline parameters. Attention: Inline parameters override the values in the config file.
-h		Allows you to display help for a DataUploader command.

Loading Data using DataUploader

Follow these steps to load data using DataUploader.

1. Download the DataUploader.

2. Create a folder and copy the input files the that you want to upload using DataUploader in this folder.

3. Open a Windows Powershell.

4. Navigate to the location where you downloaded the DataUploader.

5. Enter the following command:

   .\process-mining-data-uploader.exe "<csv dir>" "<sas url>" "<end-of-upload api>" ["<delimiter>"]

6. Press Enter.

Below is an example of the command string.

./process-mining-data-uploader.exe "data" "https://asdf.blob.core.windows.net/a28d10b0-6822-4ffc-a197-02ed39824ad4?sv=2020-06-12&si=sap-a58d10b0-6822-4ffc-a197-02ed649824ad4&sr=c&sig=WELk3bW8zpY5rL71lJ8pPPhlOq0odLNoQleY%2BL3nPqek%3D" "https://asdf.uipath.com/org/defaulttenant/processmining_/api/v4.0/apps/a28d10b0-6822-4ffc-a197-02ed39824ad4/ingest/authenticated?AppSecretToken=A5B221AD00E66D02677E36F572EFDEAFB61E2440320D44666CA4DF3D0D81410EF" "44"

If the upload fails, for example, due to an unstable connection, DataUploader will retry the upload up to 4 times. If the data upload was not successful after 5 times, a report is created.

Warning:

Under certain network configurations DataUploader fails to reach the end-of-upload API due to a self signed certificate, and you will get the error such as UNABLE_TO_GET_ISSUER_CERT_LOCALLY.

This can be resolved by pointing DataUploader to your organization's Certificate Authority (CA) certificate.

Follow these steps.

1. Create an environment variable called NODE_EXTRA_CA_CERTS.

2. Set the value of the new environment variable to the file path of your CA certificate.

In case some of the files have failed the upload, you can restart DataUploader using the same command and with same files.