Debezium

On this page

1. Debezium source Connector/debezium-connect

Debezium source Connector/debezium-connect

1. The Helm chart for debezium-connect should be available under charts/debezium.

2. Validate image repository and tag:

   image:
     repository: quay.io/debezium/connect
     tag: <release-version-tag> e.g v1.0.1
   

3. Configurations for the following should be on hand to update the values.yaml file- NBS_ODSE hostname, username, password and kafka bootstrap server names. Replace all "EXAMPLE_MSK_KAFKA_ENDPOINT" with Kafka endpoints, Replace all "nbs-db.private-EXAMPLE_DOMAIN" with SQL server domain name, Replace all instances of "EXAMPLE_DB_USER" with SQL Server user name, Replace all instances of "EXAMPLE_DB_USER_PASSWORD" with SQL Server password

   properties:
     bootstrap_server: "EXAMPLE_MSK_KAFKA_ENDPOINT"
   
   sqlserverconnector_odse:
     config:
       database.hostname: "nbs-db.private-EXAMPLE_DOMAIN",
       database.port: "1433",
       database.user: "EXAMPLE_ODSE_DB_USER",
       database.password: "EXAMPLE_ODSE_DB_USER_PASSWORD",
       database.dbname: "nbs_odse",
       database.names: "nbs_odse",
       database.server.name: "odse",
       database.history.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT",
       schema.history.internal.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT"
   
   sqlserverconnector_odse_meta:
     config:
       database.hostname: "nbs-db.private-EXAMPLE_DOMAIN",
       database.port: "1433",
       database.user: "EXAMPLE_ODSE_DB_USER",
       database.password: "EXAMPLE_ODSE_DB_USER_PASSWORD",
       database.dbname: "nbs_odse",
       database.names: "nbs_odse",
       database.server.name: "odse",
       database.history.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT",
       schema.history.internal.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT"
   
   sqlserverconnector_srte:
     config:
       database.hostname: "nbs-db.private-EXAMPLE_DOMAIN",
       database.port: "1433",
       database.user: "EXAMPLE_SRTE_DB_USER",
       database.password: "EXAMPLE_SRTE_DB_USER_PASSWORD",
       database.dbname: "nbs_odse",
       database.names: "nbs_odse",
       database.server.name: "odse",
       database.history.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT",
       schema.history.internal.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT"
   env:
     - name: BOOTSTRAP_SERVERS
       value: "EXAMPLE_MSK_KAFKA_ENDPOINT"
   

4. Install pod

   Helm install -f ./debezium/values.yaml debezium-connect ./debezium/
   

5. Verify if pod is running

   kubectl get pods
   

6. Validate service

• a. This is an internal service with no ingress. Validation should be part of RTR Pipeline Validation

• b. If the service has any trouble connecting with the database, run this command to reset the ConfigMap.

  kubectl delete configmap cp-kafka-connect-sqlserver-connect