Installation Guide - Docker
Analytics Data Processing: This service is a long running job that gets data from the operational database (source) and stores it in the analytics database (target). Data is transformed and prepared for analytical purposes in the analytics database.
Prerequisites
- Installation of EWA (v32.0.0 or greater)
- Available database (Microsoft SQL Server)
Configuration options
The service should be configured with the following environment variables when the container is started:
| Setting Name | Description | default value |
|---|---|---|
| BLIKSUND_RUN_SCHEDULED | true if running the service on a schedule, false if running once | false |
| BLIKSUND_RUN_SCHEDULED_FREQUENCY_MIN | Minutes between each run | 60 |
| BLIKSUND_LOAD_BATCH_SIZE | Number of rows fetched in each batch from the EWA Database | 50000 |
| BLIKSUND_LOAD_BATCH_WAIT_TIME | Seconds to wait between each batch of data | 1 |
| BLIKSUND_LOAD_FULL_ON_SCHEDULE | true for full load on schedule, false for incremental | false |
| BLIKSUND_LOAD_FULL_ON_START | true for full load on service start, false for incremental | false |
| BLIKSUND_TRANSFORM_FULL_ON_SCHEDULE | true for full transform on schedule, false for incremental | false |
| BLIKSUND_TRANSFORM_FULL_ON_START | true for full transform on service start, false for incremental | false |
| BLIKSUND_RUN_TAG | false if no run tag is used; otherwise, schemas are prefixed with the tag | false |
| SOURCE__DATABASE__TYPE | Type of source database (use mssql) | (empty) |
| SOURCE__DATABASE__USERNAME | Username for source database | (empty) |
| SOURCE__DATABASE__PASSWORD | Password for source database | (empty) |
| SOURCE__DATABASE__HOST | Host for source database | (empty) |
| SOURCE__DATABASE__PORT | Port for source database | (empty) |
| SOURCE__DATABASE__NAME | Name of source database | (empty) |
| SOURCE__DATABASE__TRUST_SERVER_CERTIFICATE | Trust server certificate option yes or no | yes |
| SOURCE__DATABASE__ENCRYPT | Encryption option yes or no | yes |
| TARGET__DATABASE__TYPE | Type of target database (use mssql) | (empty) |
| TARGET__DATABASE__USERNAME | Username for target database | (empty) |
| TARGET__DATABASE__PASSWORD | Password for target database | (empty) |
| TARGET__DATABASE__HOST | Host for target database | (empty) |
| TARGET__DATABASE__PORT | Port for target database | (empty) |
| TARGET__DATABASE__NAME | Name of target database | (empty) |
| TARGET__DATABASE__TRUST_SERVER_CERTIFICATE | Trust server certificate option yes or no | yes |
| TARGET__DATABASE__ENCRYPT | Encryption option yes or no | yes |
Running the container
Use the following command to run the Analytics Data Processing container with the required configuration:
docker run -d \
--name analytics-data-processing \
-e BLIKSUND_RUN_SCHEDULED="true" \
-e BLIKSUND_RUN_SCHEDULED_FREQUENCY_MIN="60" \
-e BLIKSUND_LOAD_BATCH_SIZE="50000" \
-e BLIKSUND_LOAD_BATCH_WAIT_TIME="1" \
-e BLIKSUND_LOAD_FULL_ON_SCHEDULE="false" \
-e BLIKSUND_LOAD_FULL_ON_START="false" \
-e BLIKSUND_TRANSFORM_FULL_ON_SCHEDULE="false" \
-e BLIKSUND_TRANSFORM_FULL_ON_START="false" \
-e BLIKSUND_RUN_TAG="false" \
-e SOURCE__DATABASE__TYPE="mssql" \
-e SOURCE__DATABASE__USERNAME="source-db-username" \
-e SOURCE__DATABASE__PASSWORD="source-db-password" \
-e SOURCE__DATABASE__HOST="source-db-host" \
-e SOURCE__DATABASE__PORT="1433" \
-e SOURCE__DATABASE__NAME="ewa" \
-e SOURCE__DATABASE__TRUST_SERVER_CERTIFICATE="yes" \
-e SOURCE__DATABASE__ENCRYPT="yes" \
-e TARGET__DATABASE__TYPE="mssql" \
-e TARGET__DATABASE__USERNAME="target-db-username" \
-e TARGET__DATABASE__PASSWORD="target-db-password" \
-e TARGET__DATABASE__HOST="target-db-host" \
-e TARGET__DATABASE__PORT="1433" \
-e TARGET__DATABASE__NAME="analytics" \
-e TARGET__DATABASE__TRUST_SERVER_CERTIFICATE="yes" \
-e TARGET__DATABASE__ENCRYPT="yes" \
<image-name>:<tag>
Replace the placeholder values with your actual configuration details.