Skip to main content

Installation Guide - Docker

Analytics Data Processing: This service is a long running job that gets data from the operational database (source) and stores it in the analytics database (target). Data is transformed and prepared for analytical purposes in the analytics database.

Prerequisites

  • Installation of EWA (v32.0.0 or greater)
  • Available database (Microsoft SQL Server)

Configuration options

The service should be configured with the following environment variables when the container is started:

Setting NameDescriptiondefault value
BLIKSUND_RUN_SCHEDULEDtrue if running the service on a schedule, false if running oncefalse
BLIKSUND_RUN_SCHEDULED_FREQUENCY_MINMinutes between each run60
BLIKSUND_LOAD_BATCH_SIZENumber of rows fetched in each batch from the EWA Database50000
BLIKSUND_LOAD_BATCH_WAIT_TIMESeconds to wait between each batch of data1
BLIKSUND_LOAD_FULL_ON_SCHEDULEtrue for full load on schedule, false for incrementalfalse
BLIKSUND_LOAD_FULL_ON_STARTtrue for full load on service start, false for incrementalfalse
BLIKSUND_TRANSFORM_FULL_ON_SCHEDULEtrue for full transform on schedule, false for incrementalfalse
BLIKSUND_TRANSFORM_FULL_ON_STARTtrue for full transform on service start, false for incrementalfalse
BLIKSUND_RUN_TAGfalse if no run tag is used; otherwise, schemas are prefixed with the tagfalse
SOURCE__DATABASE__TYPEType of source database (use mssql)(empty)
SOURCE__DATABASE__USERNAMEUsername for source database(empty)
SOURCE__DATABASE__PASSWORDPassword for source database(empty)
SOURCE__DATABASE__HOSTHost for source database(empty)
SOURCE__DATABASE__PORTPort for source database(empty)
SOURCE__DATABASE__NAMEName of source database(empty)
SOURCE__DATABASE__TRUST_SERVER_CERTIFICATETrust server certificate option yes or noyes
SOURCE__DATABASE__ENCRYPTEncryption option yes or noyes
TARGET__DATABASE__TYPEType of target database (use mssql)(empty)
TARGET__DATABASE__USERNAMEUsername for target database(empty)
TARGET__DATABASE__PASSWORDPassword for target database(empty)
TARGET__DATABASE__HOSTHost for target database(empty)
TARGET__DATABASE__PORTPort for target database(empty)
TARGET__DATABASE__NAMEName of target database(empty)
TARGET__DATABASE__TRUST_SERVER_CERTIFICATETrust server certificate option yes or noyes
TARGET__DATABASE__ENCRYPTEncryption option yes or noyes

Running the container

Use the following command to run the Analytics Data Processing container with the required configuration:

docker run -d \
--name analytics-data-processing \
-e BLIKSUND_RUN_SCHEDULED="true" \
-e BLIKSUND_RUN_SCHEDULED_FREQUENCY_MIN="60" \
-e BLIKSUND_LOAD_BATCH_SIZE="50000" \
-e BLIKSUND_LOAD_BATCH_WAIT_TIME="1" \
-e BLIKSUND_LOAD_FULL_ON_SCHEDULE="false" \
-e BLIKSUND_LOAD_FULL_ON_START="false" \
-e BLIKSUND_TRANSFORM_FULL_ON_SCHEDULE="false" \
-e BLIKSUND_TRANSFORM_FULL_ON_START="false" \
-e BLIKSUND_RUN_TAG="false" \
-e SOURCE__DATABASE__TYPE="mssql" \
-e SOURCE__DATABASE__USERNAME="source-db-username" \
-e SOURCE__DATABASE__PASSWORD="source-db-password" \
-e SOURCE__DATABASE__HOST="source-db-host" \
-e SOURCE__DATABASE__PORT="1433" \
-e SOURCE__DATABASE__NAME="ewa" \
-e SOURCE__DATABASE__TRUST_SERVER_CERTIFICATE="yes" \
-e SOURCE__DATABASE__ENCRYPT="yes" \
-e TARGET__DATABASE__TYPE="mssql" \
-e TARGET__DATABASE__USERNAME="target-db-username" \
-e TARGET__DATABASE__PASSWORD="target-db-password" \
-e TARGET__DATABASE__HOST="target-db-host" \
-e TARGET__DATABASE__PORT="1433" \
-e TARGET__DATABASE__NAME="analytics" \
-e TARGET__DATABASE__TRUST_SERVER_CERTIFICATE="yes" \
-e TARGET__DATABASE__ENCRYPT="yes" \
<image-name>:<tag>

Replace the placeholder values with your actual configuration details.