2024-09-16 05:59:19 INFO juju unit_agent.go:289 Starting unit workers for "tf-kubernetes-master/2"
2024-09-16 05:59:19 INFO juju.worker.apicaller connect.go:163 [1de1c6] "unit-tf-kubernetes-master-2" successfully connected to "10.0.0.29:17070"
2024-09-16 05:59:19 INFO juju.worker.apicaller connect.go:260 [1de1c6] password changed for "unit-tf-kubernetes-master-2"
2024-09-16 05:59:19 INFO juju.worker.apicaller connect.go:163 [1de1c6] "unit-tf-kubernetes-master-2" successfully connected to "10.0.0.29:17070"
2024-09-16 05:59:19 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE
2024-09-16 05:59:19 INFO juju.worker.logger logger.go:120 logger worker started
2024-09-16 05:59:19 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-09-16 05:59:19.533669043 +0000 UTC
2024-09-16 05:59:19 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2024-09-16 05:59:19.53907656 +0000 UTC
2024-09-16 05:59:19 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-09-16 05:59:19.544914906 +0000 UTC
2024-09-16 05:59:19 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher
2024-09-16 05:59:19 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done
2024-09-16 05:59:19 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully
2024-09-16 05:59:19 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.29:17070 252.29.0.1:17070 127.0.0.1:17070 [::1]:17070]]
2024-09-16 05:59:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed)
2024-09-16 05:59:19 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-tf-kubernetes-master-2/run.socket <nil>}
2024-09-16 05:59:19 INFO juju.worker.uniter uniter.go:335 unit "tf-kubernetes-master/2" started
2024-09-16 05:59:19 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running
2024-09-16 05:59:19 INFO juju.worker.uniter uniter.go:651 resuming charm install
2024-09-16 05:59:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation install local:focal/contrail-kubernetes-master-0 for tf-kubernetes-master/2
2024-09-16 05:59:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/2
2024-09-16 05:59:19 INFO juju.worker.uniter.charm bundles.go:81 downloading local:focal/contrail-kubernetes-master-0 from API server
2024-09-16 05:59:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/2
2024-09-16 05:59:19 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "local:focal/contrail-kubernetes-master-0"
2024-09-16 05:59:19 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "local:focal/contrail-kubernetes-master-0"
2024-09-16 05:59:19 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "local:focal/contrail-kubernetes-master-0"
2024-09-16 05:59:19 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/2
2024-09-16 05:59:19 INFO juju.worker.uniter uniter.go:361 hooks are retried false
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for tf-kubernetes-master/2: ok=true
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for tf-kubernetes-master/2
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for tf-kubernetes-master/2: [] ok=true
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for tf-kubernetes-master/2: ok=true, hashes=[7841c3fcc8a910cec6593d8c128bc513ecf64bda54990f9ddb332ab990a28954]
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for tf-kubernetes-master/2: ok=true
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for tf-kubernetes-master/2: ok=true, hashes=[3dfed8430827e8ff7931201b24a9d468b7bcf27b57ef810c7ca3686843eee08b]
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for tf-kubernetes-master/2: ok=true, hashes=[c793c7b9daea21c682bd624bf532f70e995812541acbae91ef29d0f8351777be]
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for tf-kubernetes-master/2: [] ok=true
2024-09-16 05:59:20 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for tf-kubernetes-master/2
2024-09-16 05:59:20 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready
2024-09-16 05:59:20 INFO juju.worker.uniter resolver.go:159 found queued "install" hook
2024-09-16 05:59:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for tf-kubernetes-master/2
2024-09-16 05:59:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run install hook)
2024-09-16 05:59:25 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{0}] map[] []}}
2024-09-16 05:59:34 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{0}] map[] []}}
2024-09-16 05:59:44 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {24 {map[tf-kubernetes-node/0:{0} tf-kubernetes-node/4:{0}] map[] []}}
2024-09-16 05:59:50 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {18 {map[tf-kubernetes-master/1:{0}] map[] []}}
2024-09-16 05:59:55 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed)
2024-09-16 05:59:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 05:59:55 INFO juju.worker.meterstatus runner.go:89 skipped "meter-status-changed" hook (missing)
2024-09-16 05:59:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 05:59:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed)
2024-09-16 05:59:55 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run install hook)
2024-09-16 05:59:55 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for tf-kubernetes-master/2
2024-09-16 05:59:55 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for tf-kubernetes-master/2
2024-09-16 05:59:55 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook
2024-09-16 05:59:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 05:59:56 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Installing logrotate with options: ['--option=Dpkg::Options::=--force-confold']
2024-09-16 05:59:56 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Reading package lists...
2024-09-16 05:59:56 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Building dependency tree...
2024-09-16 05:59:56 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Reading state information...
2024-09-16 05:59:56 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {27 {map[kubernetes-master/0:{1}] map[] []}}
2024-09-16 05:59:56 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 logrotate is already the newest version (3.14.0-4ubuntu3).
2024-09-16 05:59:56 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.
2024-09-16 05:59:56 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Installing ['apt-transport-https', 'ca-certificates', 'curl', 'software-properties-common'] with options: ['--option=Dpkg::Options::=--force-confold']
2024-09-16 05:59:56 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Reading package lists...
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Building dependency tree...
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Reading state information...
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 ca-certificates is already the newest version (20230311ubuntu0.20.04.1).
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 curl is already the newest version (7.68.0-1ubuntu2.22).
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 software-properties-common is already the newest version (0.99.9.12).
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 apt-transport-https is already the newest version (2.0.10).
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal InRelease
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security InRelease
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates InRelease
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed InRelease
2024-09-16 05:59:57 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Hit:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-backports InRelease
2024-09-16 05:59:59 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Reading package lists...
2024-09-16 05:59:59 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Installing docker.io with options: ['--option=Dpkg::Options::=--force-confold']
2024-09-16 05:59:59 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Reading package lists...
2024-09-16 05:59:59 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Building dependency tree...
2024-09-16 05:59:59 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Reading state information...
2024-09-16 06:00:00 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 docker.io is already the newest version (24.0.5-0ubuntu1~20.04.1).
2024-09-16 06:00:00 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.
2024-09-16 06:00:00 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Installing ['docker-compose'] with options: ['--option=Dpkg::Options::=--force-confold']
2024-09-16 06:00:00 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Reading package lists...
2024-09-16 06:00:00 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Building dependency tree...
2024-09-16 06:00:00 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 Reading state information...
2024-09-16 06:00:00 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 docker-compose is already the newest version (1.25.0-1).
2024-09-16 06:00:00 DEBUG unit.tf-kubernetes-master/2.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.
2024-09-16 06:00:00 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292
2024-09-16 06:00:02 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script)
2024-09-16 06:00:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for tf-kubernetes-master/2
2024-09-16 06:00:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:00:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run install hook)
2024-09-16 06:00:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:00:02 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/2" (leader=false) entered scope for relation "tf-kubernetes-master:kube-api-endpoint kubernetes-master:kube-api-endpoint"
2024-09-16 06:00:02 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/2" (leader=false) entered scope for relation "tf-kubernetes-master:kubernetes-master-cluster"
2024-09-16 06:00:02 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/2" (leader=false) entered scope for relation "tf-kubernetes-master:contrail-controller tf-controller:contrail-controller"
2024-09-16 06:00:02 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/2" (leader=false) entered scope for relation "tf-kubernetes-node:contrail-kubernetes-config tf-kubernetes-master:contrail-kubernetes-config"
2024-09-16 06:00:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (27; app: kubernetes-master) hook for tf-kubernetes-master/2
2024-09-16 06:00:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-created (27; app: kubernetes-master) hook)
2024-09-16 06:00:06 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {24 {map[tf-kubernetes-node/3:{0}] map[] []}}
2024-09-16 06:00:12 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {18 {map[tf-kubernetes-master/0:{0}] map[] []}}
2024-09-16 06:00:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-created (27; app: kubernetes-master) hook)
2024-09-16 06:00:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/2
2024-09-16 06:00:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/2
2024-09-16 06:00:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-created hook
2024-09-16 06:00:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:00:18 INFO juju.worker.uniter.operation runhook.go:162 skipped "kube-api-endpoint-relation-created" hook (missing)
2024-09-16 06:00:18 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/2
2024-09-16 06:00:18 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:00:18 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-created (27; app: kubernetes-master) hook)
2024-09-16 06:00:18 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:00:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (18; app: tf-kubernetes-master) hook for tf-kubernetes-master/2
2024-09-16 06:00:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-created (18; app: tf-kubernetes-master) hook)
2024-09-16 06:00:31 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-created (18; app: tf-kubernetes-master) hook)
2024-09-16 06:00:31 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/2
2024-09-16 06:00:31 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/2
2024-09-16 06:00:31 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-created hook
2024-09-16 06:00:31 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:00:31 INFO juju.worker.uniter.operation runhook.go:162 skipped "kubernetes-master-cluster-relation-created" hook (missing)
2024-09-16 06:00:32 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/2
2024-09-16 06:00:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:00:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-created (18; app: tf-kubernetes-master) hook)
2024-09-16 06:00:32 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:00:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (23; app: tf-controller) hook for tf-kubernetes-master/2
2024-09-16 06:00:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-created (23; app: tf-controller) hook)
2024-09-16 06:01:10 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{1}] map[] []}}
2024-09-16 06:01:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-created (23; app: tf-controller) hook)
2024-09-16 06:01:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/2
2024-09-16 06:01:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/2
2024-09-16 06:01:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-created hook
2024-09-16 06:01:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:01:11 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-controller-relation-created" hook (missing)
2024-09-16 06:01:11 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/2
2024-09-16 06:01:11 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:01:11 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-created (23; app: tf-controller) hook)
2024-09-16 06:01:11 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:01:11 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (24; app: tf-kubernetes-node) hook for tf-kubernetes-master/2
2024-09-16 06:01:11 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-created (24; app: tf-kubernetes-node) hook)
2024-09-16 06:01:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-created (24; app: tf-kubernetes-node) hook)
2024-09-16 06:01:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/2
2024-09-16 06:01:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/2
2024-09-16 06:01:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-created hook
2024-09-16 06:01:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:01:30 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-kubernetes-config-relation-created" hook (missing)
2024-09-16 06:01:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/2
2024-09-16 06:01:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:01:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-created (24; app: tf-kubernetes-node) hook)
2024-09-16 06:01:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:01:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for tf-kubernetes-master/2
2024-09-16 06:01:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:01:31 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{1}] map[] []}}
2024-09-16 06:01:31 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:01:31 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:01:31 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:01:31 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook
2024-09-16 06:01:31 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:01:31 INFO juju.worker.uniter.operation runhook.go:162 skipped "leader-settings-changed" hook (missing)
2024-09-16 06:01:31 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:01:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:01:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:01:32 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:01:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:01:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for tf-kubernetes-master/2
2024-09-16 06:01:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run config-changed hook)
2024-09-16 06:01:38 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{1}] map[] []}}
2024-09-16 06:01:38 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 06:02:01 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{2}] map[] []}}
2024-09-16 06:02:15 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run config-changed hook)
2024-09-16 06:02:15 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for tf-kubernetes-master/2
2024-09-16 06:02:15 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for tf-kubernetes-master/2
2024-09-16 06:02:15 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook
2024-09-16 06:02:15 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:02:15 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 /usr/bin/rsync -r --executability /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/files/plugins/ /usr/local/lib/nagios/plugins
2024-09-16 06:02:15 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Nagios user not set up, nrpe checks not updated
2024-09-16 06:02:15 WARNING unit.tf-kubernetes-master/2.config-changed logger.go:60 Error: No such object: nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-1_0_3_3-1
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 master-1_0_3_3-1: Pulling from contrail-kubernetes-kube-manager
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 2d473b07cdd5: Already exists
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 49fddd2fcc24: Already exists
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 8e5d452e69ee: Already exists
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 cfd65fe25765: Already exists
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 cf758c81aad1: Already exists
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 3adfdf1ce16b: Already exists
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 07ccc7fbc14d: Already exists
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 522ba1fa7c76: Already exists
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 de031bf54fc4: Already exists
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 a4e7ea08e926: Pulling fs layer
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 11701ac60d07: Pulling fs layer
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 11701ac60d07: Verifying Checksum
2024-09-16 06:02:15 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 11701ac60d07: Download complete
2024-09-16 06:02:16 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 a4e7ea08e926: Verifying Checksum
2024-09-16 06:02:16 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 a4e7ea08e926: Download complete
2024-09-16 06:02:17 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 a4e7ea08e926: Pull complete
2024-09-16 06:02:17 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 11701ac60d07: Pull complete
2024-09-16 06:02:17 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 Digest: sha256:34357d55a6ac757add5beb22dda7d394054eb74475da8508c0c176fbe9315637
2024-09-16 06:02:17 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 Status: Downloaded newer image for nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-1_0_3_3-1
2024-09-16 06:02:17 DEBUG unit.tf-kubernetes-master/2.config-changed logger.go:60 nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-1_0_3_3-1
2024-09-16 06:02:17 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:02:17 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:02:18 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:02:18 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for tf-kubernetes-master/2
2024-09-16 06:02:18 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:02:18 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run config-changed hook)
2024-09-16 06:02:18 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:02:18 INFO juju.worker.uniter resolver.go:159 found queued "start" hook
2024-09-16 06:02:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for tf-kubernetes-master/2
2024-09-16 06:02:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run start hook)
2024-09-16 06:02:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run start hook)
2024-09-16 06:02:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for tf-kubernetes-master/2
2024-09-16 06:02:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for tf-kubernetes-master/2
2024-09-16 06:02:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook
2024-09-16 06:02:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:02:22 INFO juju.worker.uniter.operation runhook.go:162 skipped "start" hook (missing)
2024-09-16 06:02:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for tf-kubernetes-master/2
2024-09-16 06:02:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:02:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run start hook)
2024-09-16 06:02:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:02:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for tf-kubernetes-master/2
2024-09-16 06:02:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:02:22 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-09-16 06:02:22.727739604 +0000 UTC
2024-09-16 06:02:29 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {18 {map[tf-kubernetes-master/1:{1}] map[] []}}
2024-09-16 06:02:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:02:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:02:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:02:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook
2024-09-16 06:02:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:02:36 INFO juju.worker.uniter.operation runhook.go:162 skipped "leader-settings-changed" hook (missing)
2024-09-16 06:02:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:02:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:02:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:02:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:02:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:02:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (27; unit: kubernetes-master/0) hook for tf-kubernetes-master/2
2024-09-16 06:02:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (27; unit: kubernetes-master/0) hook)
2024-09-16 06:02:37 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{3}] map[] []}}
2024-09-16 06:02:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (27; unit: kubernetes-master/0) hook)
2024-09-16 06:02:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:02:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:02:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-joined hook for kubernetes-master/0
2024-09-16 06:02:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:02:41 INFO juju.worker.uniter.operation runhook.go:162 skipped "kube-api-endpoint-relation-joined" hook (missing)
2024-09-16 06:02:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:02:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:02:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (27; unit: kubernetes-master/0) hook)
2024-09-16 06:02:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:02:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:02:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (27; unit: kubernetes-master/0) hook for tf-kubernetes-master/2
2024-09-16 06:02:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (27; unit: kubernetes-master/0) hook)
2024-09-16 06:02:41 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{4}] map[] []}}
2024-09-16 06:03:55 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (27; unit: kubernetes-master/0) hook)
2024-09-16 06:03:55 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:03:55 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:03:55 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-changed hook for kubernetes-master/0
2024-09-16 06:03:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:03:55 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 kube-api-endpoint:27: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:03:55 INFO juju.worker.uniter.operation runhook.go:159 ran "kube-api-endpoint-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:03:55 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:03:56 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:03:56 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (27; unit: kubernetes-master/0) hook)
2024-09-16 06:03:56 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:03:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:03:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/0) hook for tf-kubernetes-master/2
2024-09-16 06:03:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook)
2024-09-16 06:03:58 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook)
2024-09-16 06:03:58 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/2
2024-09-16 06:03:58 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/2
2024-09-16 06:03:58 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/0
2024-09-16 06:03:58 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:03:58 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:03:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/2
2024-09-16 06:03:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:03:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook)
2024-09-16 06:03:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:03:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:03:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (18; unit: tf-kubernetes-master/0) hook for tf-kubernetes-master/2
2024-09-16 06:03:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (18; unit: tf-kubernetes-master/0) hook)
2024-09-16 06:04:01 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{2}] map[] []}}
2024-09-16 06:04:01 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (18; unit: tf-kubernetes-master/0) hook)
2024-09-16 06:04:01 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (18; unit: tf-kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:04:01 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (18; unit: tf-kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:04:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-joined hook for tf-kubernetes-master/0
2024-09-16 06:04:01 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:04:02 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:04:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (18; unit: tf-kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:04:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:04:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (18; unit: tf-kubernetes-master/0) hook)
2024-09-16 06:04:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:04:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:04:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (18; unit: tf-kubernetes-master/0) hook for tf-kubernetes-master/2
2024-09-16 06:04:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (18; unit: tf-kubernetes-master/0) hook)
2024-09-16 06:04:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (18; unit: tf-kubernetes-master/0) hook)
2024-09-16 06:04:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (18; unit: tf-kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:04:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (18; unit: tf-kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:04:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-changed hook for tf-kubernetes-master/0
2024-09-16 06:04:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:04:06 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 kubernetes-master-cluster:18: Peer relation changed with tf-kubernetes-master/0: {'egress-subnets': '10.0.0.31/32', 'ingress-address': '10.0.0.31', 'private-address': '10.0.0.31'}
2024-09-16 06:04:06 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 kubernetes-master-cluster:18: There is no unit-address in the relation
2024-09-16 06:04:06 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 kubernetes-master-cluster:18: ZIU: stage from relation None
2024-09-16 06:04:06 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:04:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (18; unit: tf-kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:04:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:04:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (18; unit: tf-kubernetes-master/0) hook)
2024-09-16 06:04:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:04:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:04:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:04:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:04:06 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (18; unit: tf-kubernetes-master/1) hook for tf-kubernetes-master/2
2024-09-16 06:04:06 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (18; unit: tf-kubernetes-master/1) hook)
2024-09-16 06:04:17 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{2}] map[] []}}
2024-09-16 06:04:20 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{3}] map[] []}}
2024-09-16 06:04:26 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {18 {map[tf-kubernetes-master/0:{1}] map[] []}}
2024-09-16 06:04:28 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 06:04:28 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:04:29 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{4}] map[] []}}
2024-09-16 06:04:33 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{5}] map[] []}}
2024-09-16 06:04:37 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 06:04:39 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 06:04:44 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{5}] map[] []}}
2024-09-16 06:04:47 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{6}] map[] []}}
2024-09-16 06:04:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (18; unit: tf-kubernetes-master/1) hook)
2024-09-16 06:04:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/2
2024-09-16 06:04:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/2
2024-09-16 06:04:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-joined hook for tf-kubernetes-master/1
2024-09-16 06:04:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:04:50 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:04:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/2
2024-09-16 06:04:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:04:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (18; unit: tf-kubernetes-master/1) hook)
2024-09-16 06:04:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:04:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for tf-kubernetes-master/2
2024-09-16 06:04:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:04:52 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{3}] map[] []}}
2024-09-16 06:04:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:04:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:04:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:04:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook
2024-09-16 06:04:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:04:53 INFO juju.worker.uniter.operation runhook.go:162 skipped "leader-settings-changed" hook (missing)
2024-09-16 06:04:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:04:53 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{7}] map[] []}}
2024-09-16 06:04:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:04:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:04:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:04:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:04:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (18; unit: tf-kubernetes-master/1) hook for tf-kubernetes-master/2
2024-09-16 06:04:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (18; unit: tf-kubernetes-master/1) hook)
2024-09-16 06:04:58 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{6}] map[] []}}
2024-09-16 06:05:13 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{4}] map[] []}}
2024-09-16 06:05:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (18; unit: tf-kubernetes-master/1) hook)
2024-09-16 06:05:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/2
2024-09-16 06:05:14 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/2
2024-09-16 06:05:14 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-changed hook for tf-kubernetes-master/1
2024-09-16 06:05:14 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:05:14 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 kubernetes-master-cluster:18: Peer relation changed with tf-kubernetes-master/1: {'egress-subnets': '10.0.0.37/32', 'ingress-address': '10.0.0.37', 'private-address': '10.0.0.37', 'unit-address': '10.0.0.37'}
2024-09-16 06:05:14 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 kubernetes-master-cluster:18: ZIU: stage from relation None
2024-09-16 06:05:14 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:05:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/2
2024-09-16 06:05:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:05:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (18; unit: tf-kubernetes-master/1) hook)
2024-09-16 06:05:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:05:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:05:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:05:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:05:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:05:14 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (18; unit: tf-kubernetes-master/0) hook for tf-kubernetes-master/2
2024-09-16 06:05:14 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (18; unit: tf-kubernetes-master/0) hook)
2024-09-16 06:05:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (18; unit: tf-kubernetes-master/0) hook)
2024-09-16 06:05:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (18; unit: tf-kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (18; unit: tf-kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-changed hook for tf-kubernetes-master/0
2024-09-16 06:05:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:05:16 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 kubernetes-master-cluster:18: Peer relation changed with tf-kubernetes-master/0: {'egress-subnets': '10.0.0.31/32', 'ingress-address': '10.0.0.31', 'private-address': '10.0.0.31', 'unit-address': '10.0.0.31'}
2024-09-16 06:05:16 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 kubernetes-master-cluster:18: ZIU: stage from relation None
2024-09-16 06:05:16 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:05:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (18; unit: tf-kubernetes-master/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:05:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (18; unit: tf-kubernetes-master/0) hook)
2024-09-16 06:05:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:05:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:05:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:05:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (23; unit: tf-controller/0) hook)
2024-09-16 06:05:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (23; unit: tf-controller/0) hook)
2024-09-16 06:05:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-joined hook for tf-controller/0
2024-09-16 06:05:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:05:18 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:05:18 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:18 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:05:18 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (23; unit: tf-controller/0) hook)
2024-09-16 06:05:18 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:05:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:05:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:05:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:05:18 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{7}] map[] []}}
2024-09-16 06:05:19 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{5}] map[] []}}
2024-09-16 06:05:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:05:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:20 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:05:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:05:20 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:05:20 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:05:20 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:05:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:05:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:05:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:05:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:05:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:05:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:05:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:05:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (23; unit: tf-controller/1) hook for tf-kubernetes-master/2
2024-09-16 06:05:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (23; unit: tf-controller/1) hook)
2024-09-16 06:05:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (23; unit: tf-controller/1) hook)
2024-09-16 06:05:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:05:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:05:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-joined hook for tf-controller/1
2024-09-16 06:05:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:05:22 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:05:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:05:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:05:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (23; unit: tf-controller/1) hook)
2024-09-16 06:05:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:05:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:05:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:05:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:05:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:05:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/2
2024-09-16 06:05:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:05:25 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{8}] map[] []}}
2024-09-16 06:05:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:05:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:05:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:05:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1
2024-09-16 06:05:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:05:36 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:05:36 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:05:36 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:05:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:05:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:05:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:05:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:05:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:05:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:05:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:05:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:05:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:05:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (23; unit: tf-controller/2) hook for tf-kubernetes-master/2
2024-09-16 06:05:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (23; unit: tf-controller/2) hook)
2024-09-16 06:05:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (23; unit: tf-controller/2) hook)
2024-09-16 06:05:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:05:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:05:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-joined hook for tf-controller/2
2024-09-16 06:05:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:05:38 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:05:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:05:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:05:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (23; unit: tf-controller/2) hook)
2024-09-16 06:05:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:05:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:05:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/2
2024-09-16 06:05:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:05:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:05:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:05:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:05:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2
2024-09-16 06:05:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:05:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:05:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:05:43 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:05:43 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:05:43 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:05:43 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:05:43 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:05:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:05:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/0) hook for tf-kubernetes-master/2
2024-09-16 06:05:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook)
2024-09-16 06:05:44 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{6}] map[] []}}
2024-09-16 06:05:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook)
2024-09-16 06:05:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/0
2024-09-16 06:05:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:05:48 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:05:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/2
2024-09-16 06:05:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:05:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook)
2024-09-16 06:05:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:05:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:05:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:05:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:05:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:05:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:05:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:05:54 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{9}] map[] []}}
2024-09-16 06:06:06 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:06:06 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:06:06 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:06:06 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:06:06 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:06:06 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:06:06 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:06:07 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:06:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:06:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:06:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:06:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:06:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:06:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:06:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:06:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:06:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:06:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:06:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:06:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/2
2024-09-16 06:06:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:06:09 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{10}] map[] []}}
2024-09-16 06:06:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:06:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:06:15 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:06:15 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2
2024-09-16 06:06:15 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:06:15 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:06:15 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:06:15 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:06:15 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:06:15 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:06:15 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:06:15 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:06:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:06:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:06:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:06:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:06:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:06:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:06:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:06:15 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/2
2024-09-16 06:06:15 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:06:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:06:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:06:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:06:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:06:24 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:06:24 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:06:24 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{7}] map[] []}}
2024-09-16 06:06:24 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:06:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:06:24 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:06:24 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:06:24 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:06:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:06:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:06:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:06:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:06:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:06:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:06:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:06:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:06:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:06:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:06:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:06:40 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:06:40 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:06:41 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:06:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:06:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:06:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:06:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:06:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:06:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:06:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:06:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:06:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:06:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:06:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:06:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:06:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/1) hook for tf-kubernetes-master/2
2024-09-16 06:06:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook)
2024-09-16 06:07:01 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{8}] map[] []}}
2024-09-16 06:07:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook)
2024-09-16 06:07:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/2
2024-09-16 06:07:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/2
2024-09-16 06:07:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/1
2024-09-16 06:07:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:12 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:07:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/2
2024-09-16 06:07:12 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:12 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook)
2024-09-16 06:07:12 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:07:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:07:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:07:12 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:07:12 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:07:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:07:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:07:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:07:19 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:07:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:19 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:07:19 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:07:19 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:07:19 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:07:19 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:19 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:07:19 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:19 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/1) hook for tf-kubernetes-master/2
2024-09-16 06:07:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook)
2024-09-16 06:07:26 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{9}] map[] []}}
2024-09-16 06:07:26 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook)
2024-09-16 06:07:26 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/2
2024-09-16 06:07:26 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/2
2024-09-16 06:07:26 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/1
2024-09-16 06:07:26 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:26 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:07:26 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/2
2024-09-16 06:07:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook)
2024-09-16 06:07:26 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:07:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:07:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:07:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:07:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:07:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:07:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:07:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:07:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:07:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:07:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:07:27 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:07:27 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:27 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:07:27 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:07:27 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:07:27 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:07:27 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:27 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:07:27 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:27 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:07:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:07:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/2) hook for tf-kubernetes-master/2
2024-09-16 06:07:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/2) hook)
2024-09-16 06:07:33 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/2) hook)
2024-09-16 06:07:33 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/2
2024-09-16 06:07:33 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/2
2024-09-16 06:07:33 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/2
2024-09-16 06:07:33 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:33 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:07:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/2
2024-09-16 06:07:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/2) hook)
2024-09-16 06:07:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:07:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:07:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:07:33 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/2) hook for tf-kubernetes-master/2
2024-09-16 06:07:33 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/2) hook)
2024-09-16 06:07:39 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{10}] map[] []}}
2024-09-16 06:07:39 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/2) hook)
2024-09-16 06:07:39 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/2
2024-09-16 06:07:39 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/2
2024-09-16 06:07:39 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/2
2024-09-16 06:07:39 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:39 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:07:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/2
2024-09-16 06:07:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/2) hook)
2024-09-16 06:07:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:07:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:07:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:07:39 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:07:39 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:07:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:07:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:07:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:07:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:07:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:40 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:07:40 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:07:40 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:07:40 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:07:40 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:40 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:07:40 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:07:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:07:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:07:40 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/3) hook for tf-kubernetes-master/2
2024-09-16 06:07:40 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/3) hook)
2024-09-16 06:07:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/3) hook)
2024-09-16 06:07:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/2
2024-09-16 06:07:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/2
2024-09-16 06:07:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/3
2024-09-16 06:07:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:41 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:07:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/2
2024-09-16 06:07:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/3) hook)
2024-09-16 06:07:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:07:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:07:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:07:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:07:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:07:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/3) hook for tf-kubernetes-master/2
2024-09-16 06:07:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/3) hook)
2024-09-16 06:07:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/3) hook)
2024-09-16 06:07:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/2
2024-09-16 06:07:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/2
2024-09-16 06:07:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/3
2024-09-16 06:07:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:41 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/3) hook)
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/4) hook for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/4) hook)
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/4) hook)
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/4
2024-09-16 06:07:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:42 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script)
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-joined (24; unit: tf-kubernetes-node/4) hook)
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/4) hook for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/4) hook)
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/4) hook)
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/4
2024-09-16 06:07:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:07:42 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:07:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (24; unit: tf-kubernetes-node/4) hook)
2024-09-16 06:07:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:07:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:07:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:07:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:07:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:08:35 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{8}] map[] []}}
2024-09-16 06:08:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:08:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:08:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:08:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:08:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:08:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:08:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:08:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/2
2024-09-16 06:08:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:08:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:08:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:08:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:08:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1
2024-09-16 06:08:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:08:35 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:08:35 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:08:35 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:08:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:08:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:08:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:08:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:08:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:08:36 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:08:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:08:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:08:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:08:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:08:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:08:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:08:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:08:36 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:08:36 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:08:37 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:08:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:08:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:08:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:08:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:08:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:08:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:10:34 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 06:10:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for tf-kubernetes-master/2
2024-09-16 06:10:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:10:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:10:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:10:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:10:34 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook
2024-09-16 06:10:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:10:34 INFO juju.worker.uniter.operation runhook.go:162 skipped "leader-settings-changed" hook (missing)
2024-09-16 06:10:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:10:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:10:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:10:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:10:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:10:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:10:34 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:10:40 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{11}] map[] []}}
2024-09-16 06:10:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:10:40 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:10:40 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:10:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:10:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:10:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:10:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:10:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:10:40 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:10:40 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:10:40 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:10:40 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:10:40 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:10:40 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:10:40 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:10:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:10:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:10:40 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{11}] map[] []}}
2024-09-16 06:10:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:10:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:10:40 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/2
2024-09-16 06:10:40 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:10:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:10:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:10:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:10:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2
2024-09-16 06:10:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:10:41 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:10:41 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:10:41 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:10:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:10:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:10:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:10:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:10:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:10:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:10:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:10:47 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{9}] map[] []}}
2024-09-16 06:10:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:10:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:10:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:10:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:10:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:10:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:10:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/2
2024-09-16 06:10:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:10:55 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:10:55 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:10:55 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:10:55 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1
2024-09-16 06:10:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:10:55 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:10:55 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:10:55 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:10:55 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:10:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:10:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:10:55 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:10:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:10:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:10:55 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:11:45 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{10}] map[] []}}
2024-09-16 06:11:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:11:45 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/2
2024-09-16 06:11:45 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:11:45 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:11:45 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:11:45 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:11:45 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1
2024-09-16 06:11:45 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:11:45 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:11:45 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:11:45 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:11:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:11:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:11:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:11:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:11:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:11:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:11:45 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:12:16 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 06:12:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for tf-kubernetes-master/2
2024-09-16 06:12:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:12:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:12:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:12:16 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{11}] map[] []}}
2024-09-16 06:12:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:12:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook
2024-09-16 06:12:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:12:16 INFO juju.worker.uniter.operation runhook.go:162 skipped "leader-settings-changed" hook (missing)
2024-09-16 06:12:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:12:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:12:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:12:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:12:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:12:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:12:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:12:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:12:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/2
2024-09-16 06:12:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:12:23 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{12}] map[] []}}
2024-09-16 06:12:30 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 06:12:30 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{12}] map[] []}}
2024-09-16 06:12:36 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{13}] map[] []}}
2024-09-16 06:12:36 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{13}] map[] []}}
2024-09-16 06:12:43 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:12:43 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:12:43 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{12}] map[] []}}
2024-09-16 06:12:43 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:12:43 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1
2024-09-16 06:12:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:12:44 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:12:44 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:12:44 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:12:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:12:44 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:12:44 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:12:44 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:12:44 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for tf-kubernetes-master/2
2024-09-16 06:12:44 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:12:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:12:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:12:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:12:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook
2024-09-16 06:12:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:12:49 INFO juju.worker.uniter.operation runhook.go:162 skipped "leader-settings-changed" hook (missing)
2024-09-16 06:12:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:12:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:12:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:12:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:12:49 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:12:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:12:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:12:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:12:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:12:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:12:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:12:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:12:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:12:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:12:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:12:50 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:12:50 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:12:50 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:12:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:12:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1
2024-09-16 06:12:50 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:12:50 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{13}] map[] []}}
2024-09-16 06:12:50 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:12:50 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:12:50 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:12:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:12:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:12:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:12:50 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:12:50 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:12:50 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:12:50 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:12:51 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:12:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:12:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:12:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:12:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:12:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:12:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/2
2024-09-16 06:12:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:12:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:12:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:12:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:12:51 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2
2024-09-16 06:12:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:12:51 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:12:51 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:12:51 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:12:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:12:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:12:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:12:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:12:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:12:51 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:12:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:12:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:12:53 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 06:12:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for tf-kubernetes-master/2
2024-09-16 06:12:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:12:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:12:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:12:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:12:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook
2024-09-16 06:12:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:12:53 INFO juju.worker.uniter.operation runhook.go:162 skipped "leader-settings-changed" hook (missing)
2024-09-16 06:12:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:12:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:12:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:12:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:12:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:12:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:12:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:12:59 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{14}] map[] []}}
2024-09-16 06:12:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:12:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:12:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:12:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:12:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:12:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:12:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:12:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:13:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:13:00 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:13:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:13:00 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:13:00 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/2:{14}] map[] []}}
2024-09-16 06:13:00 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:13:00 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:13:00 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:13:00 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:13:00 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:13:00 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:13:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:13:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:13:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:13:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:13:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:13:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:13:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/2
2024-09-16 06:13:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:13:00 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:13:00 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:13:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:13:00 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2
2024-09-16 06:13:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:13:00 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:13:00 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:13:00 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:13:00 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:13:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:13:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:13:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:13:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:13:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:13:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:13:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:13:05 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{14}] map[] []}}
2024-09-16 06:13:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:13:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/2
2024-09-16 06:13:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:13:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:13:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:13:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:13:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1
2024-09-16 06:13:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:13:05 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:13:05 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:13:05 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:13:05 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:13:05 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:13:05 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:13:05 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:13:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:13:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:13:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:14:18 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:14:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:14:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:14:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:14:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:14:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:14:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:14:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:14:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:14:18 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/2: ok=true
2024-09-16 06:14:18 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:14:18 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:14:18 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:14:18 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Writing file /etc/contrail/common_kubemanager.env root:root 600
2024-09-16 06:14:18 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has been created and is not logged.
2024-09-16 06:14:18 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:14:18 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Making dir /etc/contrail/contrail-kubernetes-master root:root 755
2024-09-16 06:14:18 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Writing file /etc/contrail/contrail-kubernetes-master/docker-compose.yaml root:root 600
2024-09-16 06:14:18 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has been created and is not logged.
2024-09-16 06:14:18 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 Creating contrail-kubernetes-master_node-init_1 ... 
2024-09-16 06:14:19 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 
Creating contrail-kubernetes-master_node-init_1 ... done
Creating contrail-kubernetes-master_kubemanager_1 ... 
2024-09-16 06:14:21 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:14:21 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:14:21 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:14:21 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:14:21 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:14:21 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for tf-kubernetes-master/2
2024-09-16 06:14:21 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:14:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:14:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:14:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:14:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook
2024-09-16 06:14:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:14:21 INFO juju.worker.uniter.operation runhook.go:162 skipped "leader-settings-changed" hook (missing)
2024-09-16 06:14:21 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for tf-kubernetes-master/2
2024-09-16 06:14:21 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:14:21 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run leader-settings-changed hook)
2024-09-16 06:14:21 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:14:21 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:14:21 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:14:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:14:34 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/0:{15} tf-controller/2:{15}] map[] []}}
2024-09-16 06:14:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:14:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:14:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:14:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:14:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:14:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:14:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:14:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/2
2024-09-16 06:14:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:14:36 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/2 : {23 {map[tf-controller/1:{15}] map[] []}}
2024-09-16 06:14:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:14:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:14:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:14:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0
2024-09-16 06:14:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:14:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:14:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:14:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:14:42 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384
2024-09-16 06:14:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed.
2024-09-16 06:14:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:14:42 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384
2024-09-16 06:14:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed.
2024-09-16 06:14:43 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Services actual count: 2, required count: 2
2024-09-16 06:14:45 WARNING unit.tf-kubernetes-master/2.contrail-controller-relation-changed logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:14:45 WARNING unit.tf-kubernetes-master/2.contrail-controller-relation-changed logger.go:60   data = yaml.load(fh)
2024-09-16 06:14:45 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:14:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/2
2024-09-16 06:14:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:14:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/0) hook)
2024-09-16 06:14:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:14:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:14:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:14:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:14:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:14:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:14:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:14:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:14:45 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/2
2024-09-16 06:14:45 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:14:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:14:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:14:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:14:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1
2024-09-16 06:14:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:14:54 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:14:54 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:14:54 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:14:54 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384
2024-09-16 06:14:54 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed.
2024-09-16 06:14:54 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:14:54 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384
2024-09-16 06:14:54 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed.
2024-09-16 06:14:54 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Services actual count: 2, required count: 2
2024-09-16 06:14:57 WARNING unit.tf-kubernetes-master/2.contrail-controller-relation-changed logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:14:57 WARNING unit.tf-kubernetes-master/2.contrail-controller-relation-changed logger.go:60   data = yaml.load(fh)
2024-09-16 06:14:57 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:14:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/2
2024-09-16 06:14:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:14:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/1) hook)
2024-09-16 06:14:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:14:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:14:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:14:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:14:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:14:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:14:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:14:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/2
2024-09-16 06:14:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:15:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:15:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:15:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:15:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2
2024-09-16 06:15:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:15:05 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None
2024-09-16 06:15:05 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:15:05 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:15:05 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384
2024-09-16 06:15:05 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed.
2024-09-16 06:15:05 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:15:05 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384
2024-09-16 06:15:05 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed.
2024-09-16 06:15:06 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 contrail-controller:23: Services actual count: 2, required count: 2
2024-09-16 06:15:08 WARNING unit.tf-kubernetes-master/2.contrail-controller-relation-changed logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:15:08 WARNING unit.tf-kubernetes-master/2.contrail-controller-relation-changed logger.go:60   data = yaml.load(fh)
2024-09-16 06:15:08 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script)
2024-09-16 06:15:08 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/2
2024-09-16 06:15:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:15:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run relation-changed (23; unit: tf-controller/2) hook)
2024-09-16 06:15:08 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:15:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:15:08 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 
2024-09-16 06:15:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:15:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:20:03 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:20:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:20:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:20:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:20:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:20:13 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:20:13 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:20:13 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:20:13 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:20:13 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:20:13 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:20:13 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:20:13 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:20:13 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:20:13 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:20:13 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:20:13 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:20:14 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Services actual count: 2, required count: 2
2024-09-16 06:20:16 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:20:16 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60   data = yaml.load(fh)
2024-09-16 06:20:16 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:20:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:20:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:20:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:20:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:20:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:20:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:24:42 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:24:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:24:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:24:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:24:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:24:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:24:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:24:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:24:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:24:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:24:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:24:42 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:24:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:24:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:24:42 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:24:42 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:24:43 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Services actual count: 2, required count: 2
2024-09-16 06:24:45 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:24:45 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60   data = yaml.load(fh)
2024-09-16 06:24:45 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:24:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:24:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:24:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:24:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:24:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:24:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:30:36 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:30:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:30:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:30:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:30:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:30:38 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:30:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:30:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:30:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:30:38 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:30:38 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:30:38 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:30:38 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:30:38 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:30:38 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:30:38 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:30:38 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:30:38 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Services actual count: 2, required count: 2
2024-09-16 06:30:41 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:30:41 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60   data = yaml.load(fh)
2024-09-16 06:30:41 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:30:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:30:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:30:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:30:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:30:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:30:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:35:55 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:35:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:35:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:35:55 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:35:55 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:35:55 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:35:55 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:35:55 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:35:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:35:55 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:35:55 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:35:55 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:35:55 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:35:55 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:35:55 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:35:55 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:35:55 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:35:56 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Services actual count: 2, required count: 2
2024-09-16 06:35:58 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:35:58 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60   data = yaml.load(fh)
2024-09-16 06:35:58 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:35:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:35:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:35:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:35:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:35:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:35:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:41:32 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:41:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:41:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:41:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:41:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:41:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:41:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:41:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:41:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:41:32 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:41:32 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:41:32 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:41:32 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:41:32 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:41:32 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:41:32 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:41:32 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:41:32 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Services actual count: 2, required count: 2
2024-09-16 06:41:34 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:41:34 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60   data = yaml.load(fh)
2024-09-16 06:41:35 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:41:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:41:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:41:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:41:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:41:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:41:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:46:38 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:46:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:46:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:46:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:46:38 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:46:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:46:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:46:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:46:38 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:46:38 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:46:38 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:46:39 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:46:39 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:46:39 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:46:39 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:46:39 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:46:39 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Services actual count: 2, required count: 2
2024-09-16 06:46:41 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:46:41 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60   data = yaml.load(fh)
2024-09-16 06:46:41 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:46:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:46:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:46:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:46:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:46:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:46:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:51:02 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:51:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:51:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:51:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:51:15 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:51:15 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:51:15 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:51:15 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:51:15 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:51:15 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:51:15 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:51:16 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:51:16 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:51:16 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:51:16 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:51:16 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:51:16 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Services actual count: 2, required count: 2
2024-09-16 06:51:19 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:51:19 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60   data = yaml.load(fh)
2024-09-16 06:51:19 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:51:19 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:51:19 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:51:19 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:51:19 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:51:19 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:51:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:55:56 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 06:55:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:55:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 06:55:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:55:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:55:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:55:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:55:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 06:55:56 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 06:55:56 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 06:55:56 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 06:55:56 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:55:56 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:55:56 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 06:55:56 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 06:55:56 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 06:55:57 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Services actual count: 2, required count: 2
2024-09-16 06:55:59 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 06:55:59 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60   data = yaml.load(fh)
2024-09-16 06:55:59 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 06:55:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 06:55:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 06:55:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 06:55:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 06:55:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 06:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 07:01:26 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/2
2024-09-16 07:01:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 07:01:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18
2024-09-16 07:01:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/2
2024-09-16 07:01:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 07:01:26 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 07:01:26 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 07:01:26 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 07:01:26 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-2/agent.socket <nil>}
2024-09-16 07:01:26 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 ZIU: stage from config None
2024-09-16 07:01:26 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_3_3-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.31', '10.0.0.37', '10.0.0.23'], 'controller_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'control_servers': ['10.0.0.23', '10.0.0.37', '10.0.0.31'], 'analytics_servers': ['10.0.0.23', '10.0.0.31', '10.0.0.37'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IndDcnlCaEtIVFV4R2xUdUtHM1JXRTlEbnpkaDZRMEJqczJYaGNwejV1bnMifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImM5ZmJkM2E5LTNmY2MtNGRiNS1iMzQ1LWI0NDc1M2ZlYjIyMSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ds_lIRq7YWbFCmgBwOj8EBLV3bFTJXR3gueJS2AHi-SS19f8nAX2-Xxx_lZhuc8Kmzrj4dbCf6Hs_s_ruEhbbEAVEspdbguMYVbFC234suVeG1b0woiRxy1Sr0-3VoMADZ6Pxs795YQZLxVoASk9rdeAGQqSvOmzfIe4q4XCi-lFQr3Brad0NsV3Y1BY6I21STlNweZECzyqgaaAWLKIRenvNTXgXCC6fMoZOusP-ZYNtj5-xm3d84jof197mmCXolq7al-3_HTbNLi8uOjIFZDDtQQUSH1rnJuEse5MqJ7JHsykMxw-pEs7Y5NTp05j5t4B03ggPjaa4QyFoJRJdg', 'kubernetes_api_server': '10.0.0.23', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2024-09-16 07:01:26 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env
2024-09-16 07:01:26 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 07:01:26 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 07:01:26 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml
2024-09-16 07:01:26 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384
2024-09-16 07:01:26 INFO unit.tf-kubernetes-master/2.juju-log server.go:316 Configuration file has not been changed.
2024-09-16 07:01:27 DEBUG unit.tf-kubernetes-master/2.juju-log server.go:316 Services actual count: 2, required count: 2
2024-09-16 07:01:29 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-2/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
2024-09-16 07:01:29 WARNING unit.tf-kubernetes-master/2.update-status logger.go:60   data = yaml.load(fh)
2024-09-16 07:01:29 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script)
2024-09-16 07:01:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/2
2024-09-16 07:01:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2024-09-16 07:01:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/2 uniter (run update-status hook)
2024-09-16 07:01:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/2
2024-09-16 07:01:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/0" already joined relation 18
2024-09-16 07:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18