Einleitung
To edit data transformations, a local test setup is recommended for an improved edit and test experience for data engineers. A local test environment includes the following set of tools.
| Tool | Usage |
|---|---|
| dbt | to execute the data transformations on a local database. |
| Visual Studio Code | to edit the SQL code of the data transformations. |
| SQL Server (Express edition) | for testing the data transformations. |
| SQL Server Management Studio | for reviewing the result of the data transformations in the local database. |
Voraussetzungen
To install and run a dbt project, you need Python 3.9. You can download Python 3.9 from the official Python website.
Create a Python virtual environment
It is recommended to create a Python virtual environment in which you will install dbt. It is good practice to create a dedicated folder for your transformations. You can also use this folder to create the Python virtual environment.
| Step | Action |
|---|---|
| 1 | Open Windows Explorer and create a folder where your virtual environment will be located. For example, C:\My_transformations. |
| 2 | Open a Windows Command Prompt. |
Run the commands described in the steps below to create a Python Virtual environment.
| Step | Action | Command |
|---|---|---|
| 1 | Install the Python package virtualenv. | py -m pip install virtualenv |
| 2 | Go to the folder where you want to create the environment. | cd [path_to_your_folder]. For example, cd C:\My_transformations |
| 3 | Create a virtual environment (named venv). | py -m virtualenv venv |
Install dbt
Make sure the virtual environment is still activated. Follow these steps to install dbt to run transformations on Snowflake.
| Step | Action | Command |
|---|---|---|
| 1 | Activate the virtual environment. | venv\Scripts\activate |
| 2 | Install the dbt package | pip install dbt-sqlserver==1.1.0 |
| 3 | Check whether the installation is successful | dbt --version |
The returned message should start with: installed version: 1.1.2.
Visual Studio Code
Visual Studio Code is the recommended code editor for editing data transformations.
Install Visual Studio Code
You can download Visual Studio Code from Download Visual Studio Code webpage.
Erweiterungen
After you have installed Visual Studio Code, install the following extensions to make it easier to work with dbt:
- Dbt Power User
Follow these steps to install an extension in Visual Studio Code.
| Step | Action |
|---|---|
| 1 | Start Visual Studio Code |
| 2 | Go to the Extensions panel (CTRL+SHIFT+X). See the illustration below. |
| 3 | Search for the dbt Power User extension by start typing the name in the Search Extensions in Marketplace text box. |
| 4 | Click on Install. |
Siehe Abbildung unten.
Set Python interpreter path
To run Python from the virtual environment that was created, the path needs to be set in Visual Studio Code.
Führen Sie die folgenden Schritte aus.
| Step | Action |
|---|---|
| 1 | Go to File > Preference > Settings. |
| 2 | Search for Python. |
| 3 | In the Default Interpreter Path, make sure to check the path to the python.exe. It should be located in the[path_to_your_folder]\venv\Scripts folder. See the illustration below for an example. |
Microsoft SQL Server
Microsoft SQL Server is the required database to test the transformations. This database server is not provided as part of the UiPath Process Mining product. For editing and testing the transformation you can also use SQL Server Express. You can download Microsoft SQL Server Express from the official Microsoft SQL Server downloads webpage.
Hinweis:
It is recommended to test the transformations using small development datasets. This makes it possible to test these using a SQL Server with minimal requirements. If you do not have a Microsoft SQL Server available, or if you want to test the transformations on a local desktop machine, it is recommended to use Microsoft SQL Server Express.
Hinweis:
By default, SQL Server is case insensitive whereas Snowflake is case sensitive. You are advised to change the behavior of your local SQL Server database to match Snowflakes behavior, to prevent any problems. This can be accomplished by setting the right collation during installation. The default value for the collation is dependent on your locale.
To change the collation to become case sensitive, replace the
CIpart withCS, e.g.Latin1_General_CI_ASshould be changed toLatin1_General_CS_AS. If you already installed SQL Server, follow instructions here to update the collation.
Capacity calculator
You can use the to determine the hardware requirements for setting up a dedicated Microsoft SQL Server machine for Process Mining. See Capacity calculator.
SQL Server Management Studio (SSMS)
To view the database tables and to manage the SQL Server infrastructure, you can download SQL Server Management Studio (SSMS), which can be installed on any computer.
Aktualisiert vor 29 Tagen