Merging event logs

If your event log is split over multiple event log files, you can merge the event logs into a single event log in Data transformations.

Note:

To merge multiple event logs, the Case_ID should point to the same object for all files. For example, all Case IDs are pointing to Sales Order IDs., such that Case_ID points to the same table for all event logs.

1. Create a new app, based on the Event log app template. See App templates.

2. Use the Upload data option in the Selecting the Data Source step, and select the event log files you want to merge.

3. Continue the Create new app wizard to create the app and to transform the data.

   The data run will fail and the Application status will show Run failed.

4. Select View log to view the log file.

   An error message is displayed indicating that the expected Event_log_raw.sql file is not found.

   

5. Go to the Data transformations editor.

6. For each input file:

   1. Create a .sql file with the same contents as the already available Event_log_input.sql.

      

   2. Adjust the file to select the required input fields and type cast them correctly.

   3. Add the name of the new source tables to sources.yml.

      Now all new input files can be combined into a single event log.

      Attention:

      Make sure that the input files all have the exact same set of fields.

7. Select the Event_log_input.sql file and replace the contents with:

   -- The following code merges 3 input tables.
   select * from {{ ref('Event_log_input_1') }}
   union all
   select * from {{ ref('Event_log_input_2') }}
   union all
   select * from {{ ref('Event_log_input_3') }}

   
   Note: Adjust the code to match the names of the input tables needed.

8. Select Apply to dashboards to run the data transformations and make the resulting table available for use in the dashboards.