Table of contents

  1. Debezium Source Connector/debezium-connect

Debezium Source Connector/debezium-connect

  1. The helm chart for debezium-connect should be available under charts/debezium.
  2. Validate image repository and tag:
    image:
      repository: quay.io/debezium/connect
      tag: <release-version-tag> e.g v1.0.1
    
  3. Configurations for the following should be on hand to update the values.yaml file- NBS_ODSE hostname, username, password and kafka bootstrap server names. Replace all “EXAMPLE_MSK_KAFKA_ENDPOINT” with Kafka endpoints, Replace all “nbs-db.private-EXAMPLE_DOMAIN” with SQL server domain name, Replace all instances of “EXAMPLE_DB_USER” with SQL Server user name, Replace all instances of “EXAMPLE_DB_USER_PASSWORD” with SQL Server password
    properties:
      bootstrap_server: "EXAMPLE_MSK_KAFKA_ENDPOINT"
        
    sqlserverconnector_odse: 
      config: 
        database.hostname: "nbs-db.private-EXAMPLE_DOMAIN",
        database.port: "1433",
        database.user: "EXAMPLE_ODSE_DB_USER",
        database.password: "EXAMPLE_ODSE_DB_USER_PASSWORD",
        database.dbname: "nbs_odse",
        database.names: "nbs_odse",
        database.server.name: "odse",
        database.history.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT",
        schema.history.internal.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT"
       
    sqlserverconnector_odse_meta: 
      config: 
        database.hostname: "nbs-db.private-EXAMPLE_DOMAIN",
        database.port: "1433",
        database.user: "EXAMPLE_ODSE_DB_USER",
        database.password: "EXAMPLE_ODSE_DB_USER_PASSWORD",
        database.dbname: "nbs_odse",
        database.names: "nbs_odse",
        database.server.name: "odse",
        database.history.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT",
        schema.history.internal.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT"
       
    sqlserverconnector_srte: 
      config: 
        database.hostname: "nbs-db.private-EXAMPLE_DOMAIN",
        database.port: "1433",
        database.user: "EXAMPLE_SRTE_DB_USER",
        database.password: "EXAMPLE_SRTE_DB_USER_PASSWORD",
        database.dbname: "nbs_odse",
        database.names: "nbs_odse",
        database.server.name: "odse",
        database.history.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT",
        schema.history.internal.kafka.bootstrap.servers: "EXAMPLE_MSK_KAFKA_ENDPOINT"
    env:
      - name: BOOTSTRAP_SERVERS
        value: "EXAMPLE_MSK_KAFKA_ENDPOINT"
    
  4. Install pod
    helm install -f ./debezium/values.yaml debezium-connect ./debezium/
    
  5. Verify if pod is running
    kubectl get pods
    
  6. Validate service
    • a. This is an internal service with no ingress. Validation should be part of RTR Pipeline Validation
    • b. If the service has any trouble connecting with the database, run this command to reset the ConfigMap.
      kubectl delete configmap cp-kafka-connect-sqlserver-connect