2024-09-18 14:20:06 INFO juju unit_agent.go:289 Starting unit workers for "tf-kubernetes-master/0" 2024-09-18 14:20:06 INFO juju.worker.apicaller connect.go:163 [a6afe8] "unit-tf-kubernetes-master-0" successfully connected to "10.0.0.43:17070" 2024-09-18 14:20:06 INFO juju.worker.apicaller connect.go:260 [a6afe8] password changed for "unit-tf-kubernetes-master-0" 2024-09-18 14:20:06 INFO juju.worker.apicaller connect.go:163 [a6afe8] "unit-tf-kubernetes-master-0" successfully connected to "252.43.0.1:17070" 2024-09-18 14:20:06 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2024-09-18 14:20:06 INFO juju.worker.logger logger.go:120 logger worker started 2024-09-18 14:20:06 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-09-18 14:20:06.359599522 +0000 UTC 2024-09-18 14:20:06 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2024-09-18 14:20:06.360918336 +0000 UTC 2024-09-18 14:20:06 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.43:17070 252.43.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2024-09-18 14:20:06 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-09-18 14:20:06.370848136 +0000 UTC 2024-09-18 14:20:06 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-09-18 14:20:06 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2024-09-18 14:20:06 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2024-09-18 14:20:06 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2024-09-18 14:20:06 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-tf-kubernetes-master-0/run.socket } 2024-09-18 14:20:06 INFO juju.worker.uniter uniter.go:335 unit "tf-kubernetes-master/0" started 2024-09-18 14:20:06 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-09-18 14:20:06 INFO juju.worker.uniter uniter.go:651 resuming charm install 2024-09-18 14:20:06 DEBUG juju.worker.uniter.operation executor.go:85 running operation install local:focal/contrail-kubernetes-master-0 for tf-kubernetes-master/0 2024-09-18 14:20:06 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/0 2024-09-18 14:20:06 INFO juju.worker.uniter.charm bundles.go:81 downloading local:focal/contrail-kubernetes-master-0 from API server 2024-09-18 14:20:06 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/0 2024-09-18 14:20:06 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "local:focal/contrail-kubernetes-master-0" 2024-09-18 14:20:06 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "local:focal/contrail-kubernetes-master-0" 2024-09-18 14:20:06 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "local:focal/contrail-kubernetes-master-0" 2024-09-18 14:20:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/0 2024-09-18 14:20:07 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for tf-kubernetes-master/0: ok=true, hashes=[3dfed8430827e8ff7931201b24a9d468b7bcf27b57ef810c7ca3686843eee08b] 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for tf-kubernetes-master/0 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for tf-kubernetes-master/0 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for tf-kubernetes-master/0: ok=true 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for tf-kubernetes-master/0: [] ok=true 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for tf-kubernetes-master/0: ok=true, hashes=[5e03dd8a92ef0318763494336c24c0c8a591163fd092473664a1048d46899d58] 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for tf-kubernetes-master/0: [] ok=true 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for tf-kubernetes-master/0: ok=true 2024-09-18 14:20:07 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for tf-kubernetes-master/0: ok=true, hashes=[87c27cc7ab441aac80cfb90ecd56adc46d849a9c679a5d11b7e12f2a1504f6de] 2024-09-18 14:20:07 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2024-09-18 14:20:07 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2024-09-18 14:20:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for tf-kubernetes-master/0 2024-09-18 14:20:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run install hook) 2024-09-18 14:20:09 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for tf-kubernetes-master/0 2024-09-18 14:20:40 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{0}] map[] []}} 2024-09-18 14:20:40 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{0}] map[] []}} 2024-09-18 14:20:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2024-09-18 14:20:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:20:47 INFO juju.worker.meterstatus runner.go:89 skipped "meter-status-changed" hook (missing) 2024-09-18 14:20:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:20:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2024-09-18 14:20:47 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {27 {map[kubernetes-master/2:{1}] map[] []}} 2024-09-18 14:20:50 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{0}] map[] []}} 2024-09-18 14:20:51 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for tf-kubernetes-master/0 2024-09-18 14:20:51 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {24 {map[tf-kubernetes-node/2:{0}] map[] []}} 2024-09-18 14:20:52 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {24 {map[tf-kubernetes-node/1:{0}] map[] []}} 2024-09-18 14:21:03 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run install hook) 2024-09-18 14:21:03 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for tf-kubernetes-master/0 2024-09-18 14:21:03 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for tf-kubernetes-master/0 2024-09-18 14:21:03 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2024-09-18 14:21:03 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:21:04 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {24 {map[tf-kubernetes-node/3:{0}] map[] []}} 2024-09-18 14:21:04 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing logrotate with options: ['--option=Dpkg::Options::=--force-confold'] 2024-09-18 14:21:04 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-18 14:21:04 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-09-18 14:21:04 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-09-18 14:21:04 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 logrotate is already the newest version (3.14.0-4ubuntu3). 2024-09-18 14:21:04 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-18 14:21:04 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing ['apt-transport-https', 'ca-certificates', 'curl', 'software-properties-common'] with options: ['--option=Dpkg::Options::=--force-confold'] 2024-09-18 14:21:04 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-18 14:21:04 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-09-18 14:21:04 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 ca-certificates is already the newest version (20230311ubuntu0.20.04.1). 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 curl is already the newest version (7.68.0-1ubuntu2.22). 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 software-properties-common is already the newest version (0.99.9.12). 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 apt-transport-https is already the newest version (2.0.10). 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal InRelease 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security InRelease 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed InRelease 2024-09-18 14:21:05 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-18 14:21:06 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-18 14:21:06 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing docker.io with options: ['--option=Dpkg::Options::=--force-confold'] 2024-09-18 14:21:06 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 docker.io is already the newest version (24.0.5-0ubuntu1~20.04.1). 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-18 14:21:07 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing ['docker-compose'] with options: ['--option=Dpkg::Options::=--force-confold'] 2024-09-18 14:21:07 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {24 {map[tf-kubernetes-node/0:{0}] map[] []}} 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 docker-compose is already the newest version (1.25.0-1). 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-18 14:21:07 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2024-09-18 14:21:08 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2024-09-18 14:21:08 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for tf-kubernetes-master/0 2024-09-18 14:21:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:21:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run install hook) 2024-09-18 14:21:08 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:21:08 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-master:contrail-controller tf-controller:contrail-controller" 2024-09-18 14:21:09 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-node:contrail-kubernetes-config tf-kubernetes-master:contrail-kubernetes-config" 2024-09-18 14:21:09 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-master:kube-api-endpoint kubernetes-master:kube-api-endpoint" 2024-09-18 14:21:09 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-master:kubernetes-master-cluster" 2024-09-18 14:21:09 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (23; app: tf-controller) hook for tf-kubernetes-master/0 2024-09-18 14:21:09 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (23; app: tf-controller) hook) 2024-09-18 14:21:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (23; app: tf-controller) hook) 2024-09-18 14:21:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/0 2024-09-18 14:21:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/0 2024-09-18 14:21:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-created hook 2024-09-18 14:21:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:21:18 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-controller-relation-created" hook (missing) 2024-09-18 14:21:18 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/0 2024-09-18 14:21:18 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:21:18 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (23; app: tf-controller) hook) 2024-09-18 14:21:18 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:21:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (18; app: tf-kubernetes-master) hook for tf-kubernetes-master/0 2024-09-18 14:21:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (18; app: tf-kubernetes-master) hook) 2024-09-18 14:21:19 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {24 {map[tf-kubernetes-node/4:{0}] map[] []}} 2024-09-18 14:21:26 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {18 {map[tf-kubernetes-master/1:{0}] map[] []}} 2024-09-18 14:21:27 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {18 {map[tf-kubernetes-master/2:{0}] map[] []}} 2024-09-18 14:21:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (18; app: tf-kubernetes-master) hook) 2024-09-18 14:21:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-18 14:21:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-18 14:21:27 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-created hook 2024-09-18 14:21:27 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:21:27 INFO juju.worker.uniter.operation runhook.go:162 skipped "kubernetes-master-cluster-relation-created" hook (missing) 2024-09-18 14:21:27 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-18 14:21:27 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:21:27 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (18; app: tf-kubernetes-master) hook) 2024-09-18 14:21:27 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:21:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (24; app: tf-kubernetes-node) hook for tf-kubernetes-master/0 2024-09-18 14:21:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (24; app: tf-kubernetes-node) hook) 2024-09-18 14:21:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (24; app: tf-kubernetes-node) hook) 2024-09-18 14:21:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/0 2024-09-18 14:21:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/0 2024-09-18 14:21:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-created hook 2024-09-18 14:21:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:21:35 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-kubernetes-config-relation-created" hook (missing) 2024-09-18 14:21:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/0 2024-09-18 14:21:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:21:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (24; app: tf-kubernetes-node) hook) 2024-09-18 14:21:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:21:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (27; app: kubernetes-master) hook for tf-kubernetes-master/0 2024-09-18 14:21:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (27; app: kubernetes-master) hook) 2024-09-18 14:22:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (27; app: kubernetes-master) hook) 2024-09-18 14:22:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-18 14:22:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-18 14:22:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-created hook 2024-09-18 14:22:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:22:16 INFO juju.worker.uniter.operation runhook.go:162 skipped "kube-api-endpoint-relation-created" hook (missing) 2024-09-18 14:22:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-18 14:22:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:22:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (27; app: kubernetes-master) hook) 2024-09-18 14:22:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:22:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for tf-kubernetes-master/0 2024-09-18 14:22:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for tf-kubernetes-master/0 2024-09-18 14:22:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for tf-kubernetes-master/0 2024-09-18 14:22:16 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2024-09-18 14:22:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for tf-kubernetes-master/0 2024-09-18 14:22:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run leader-elected hook) 2024-09-18 14:22:24 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run leader-elected hook) 2024-09-18 14:22:24 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for tf-kubernetes-master/0 2024-09-18 14:22:24 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for tf-kubernetes-master/0 2024-09-18 14:22:24 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2024-09-18 14:22:24 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:22:24 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Cluster current info: {'tf-kubernetes-master/0': '10.0.0.53'} 2024-09-18 14:22:24 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Cluster saved info: {} 2024-09-18 14:22:24 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Cluster info: {'tf-kubernetes-master/0': '10.0.0.53'} 2024-09-18 14:22:25 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:22:25 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:22:28 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2024-09-18 14:22:28 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for tf-kubernetes-master/0 2024-09-18 14:22:28 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:22:28 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run leader-elected hook) 2024-09-18 14:22:28 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:22:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:22:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for tf-kubernetes-master/0 2024-09-18 14:22:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run config-changed hook) 2024-09-18 14:22:30 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{1}] map[] []}} 2024-09-18 14:22:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run config-changed hook) 2024-09-18 14:22:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for tf-kubernetes-master/0 2024-09-18 14:22:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for tf-kubernetes-master/0 2024-09-18 14:22:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2024-09-18 14:22:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:22:32 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 /usr/bin/rsync -r --executability /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/files/plugins/ /usr/local/lib/nagios/plugins 2024-09-18 14:22:32 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Nagios user not set up, nrpe checks not updated 2024-09-18 14:22:32 WARNING unit.tf-kubernetes-master/0.config-changed logger.go:60 Error: No such object: nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-1_0_4_6-1 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 master-1_0_4_6-1: Pulling from contrail-kubernetes-kube-manager 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 2d473b07cdd5: Already exists 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 e69c36c97604: Already exists 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 9720e153abf7: Already exists 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 d77203893088: Already exists 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 67958c3844b5: Already exists 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 2b18359b7593: Already exists 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 6c9ff25e2d65: Already exists 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 adff24c37c31: Already exists 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 a4be93fe4103: Already exists 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 d012a3222972: Pulling fs layer 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 98cb5406e663: Pulling fs layer 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 98cb5406e663: Verifying Checksum 2024-09-18 14:22:32 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 98cb5406e663: Download complete 2024-09-18 14:22:33 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 d012a3222972: Download complete 2024-09-18 14:22:34 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 d012a3222972: Pull complete 2024-09-18 14:22:34 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 98cb5406e663: Pull complete 2024-09-18 14:22:34 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 Digest: sha256:e8aad5d63c57331257705b6761bc08c51415bc658cfc30aedf61024e0523174d 2024-09-18 14:22:34 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 Status: Downloaded newer image for nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-1_0_4_6-1 2024-09-18 14:22:34 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-1_0_4_6-1 2024-09-18 14:22:34 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:22:34 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 14:22:34 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:22:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for tf-kubernetes-master/0 2024-09-18 14:22:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:22:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run config-changed hook) 2024-09-18 14:22:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:22:34 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2024-09-18 14:22:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for tf-kubernetes-master/0 2024-09-18 14:22:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run start hook) 2024-09-18 14:22:51 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{1}] map[] []}} 2024-09-18 14:22:51 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{1}] map[] []}} 2024-09-18 14:23:19 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{2}] map[] []}} 2024-09-18 14:23:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run start hook) 2024-09-18 14:23:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for tf-kubernetes-master/0 2024-09-18 14:23:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for tf-kubernetes-master/0 2024-09-18 14:23:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2024-09-18 14:23:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:25 INFO juju.worker.uniter.operation runhook.go:162 skipped "start" hook (missing) 2024-09-18 14:23:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for tf-kubernetes-master/0 2024-09-18 14:23:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run start hook) 2024-09-18 14:23:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (18; unit: tf-kubernetes-master/1) hook for tf-kubernetes-master/0 2024-09-18 14:23:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (18; unit: tf-kubernetes-master/1) hook) 2024-09-18 14:23:25 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-09-18 14:23:25.64750485 +0000 UTC 2024-09-18 14:23:26 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (18; unit: tf-kubernetes-master/1) hook) 2024-09-18 14:23:26 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:26 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:26 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-joined hook for tf-kubernetes-master/1 2024-09-18 14:23:26 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:27 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:23:27 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:27 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:27 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (18; unit: tf-kubernetes-master/1) hook) 2024-09-18 14:23:27 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:27 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (18; unit: tf-kubernetes-master/1) hook for tf-kubernetes-master/0 2024-09-18 14:23:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/1) hook) 2024-09-18 14:23:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/1) hook) 2024-09-18 14:23:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-changed hook for tf-kubernetes-master/1 2024-09-18 14:23:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:30 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: Peer relation changed with tf-kubernetes-master/1: {'egress-subnets': '10.0.0.23/32', 'ingress-address': '10.0.0.23', 'private-address': '10.0.0.23'} 2024-09-18 14:23:30 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: There is no unit-address in the relation 2024-09-18 14:23:30 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: ZIU: stage from relation None 2024-09-18 14:23:30 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:23:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/1) hook) 2024-09-18 14:23:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:23:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (18; unit: tf-kubernetes-master/2) hook for tf-kubernetes-master/0 2024-09-18 14:23:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (18; unit: tf-kubernetes-master/2) hook) 2024-09-18 14:23:39 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{2}] map[] []}} 2024-09-18 14:23:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (18; unit: tf-kubernetes-master/2) hook) 2024-09-18 14:23:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (18; unit: tf-kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (18; unit: tf-kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-joined hook for tf-kubernetes-master/2 2024-09-18 14:23:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:41 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:23:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (18; unit: tf-kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (18; unit: tf-kubernetes-master/2) hook) 2024-09-18 14:23:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:23:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/0) hook) 2024-09-18 14:23:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/0) hook) 2024-09-18 14:23:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:23:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:23:44 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-joined hook for tf-controller/0 2024-09-18 14:23:45 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:45 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:23:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:23:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/0) hook) 2024-09-18 14:23:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:45 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (18; unit: tf-kubernetes-master/2) hook for tf-kubernetes-master/0 2024-09-18 14:23:45 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/2) hook) 2024-09-18 14:23:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/2) hook) 2024-09-18 14:23:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (18; unit: tf-kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (18; unit: tf-kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-changed hook for tf-kubernetes-master/2 2024-09-18 14:23:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: Peer relation changed with tf-kubernetes-master/2: {'egress-subnets': '10.0.0.61/32', 'ingress-address': '10.0.0.61', 'private-address': '10.0.0.61'} 2024-09-18 14:23:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: There is no unit-address in the relation 2024-09-18 14:23:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: ZIU: stage from relation None 2024-09-18 14:23:47 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:23:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (18; unit: tf-kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/2) hook) 2024-09-18 14:23:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:23:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:23:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:23:47 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{3}] map[] []}} 2024-09-18 14:23:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:23:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:23:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:23:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:23:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:49 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:23:49 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:23:50 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:23:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:23:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:23:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:23:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:23:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:23:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:23:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/1) hook) 2024-09-18 14:23:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/1) hook) 2024-09-18 14:23:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:52 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-joined hook for tf-controller/1 2024-09-18 14:23:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:52 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:23:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/1) hook) 2024-09-18 14:23:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:52 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:23:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:23:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:23:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:23:54 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:23:54 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:54 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:54 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1 2024-09-18 14:23:54 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:54 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:23:54 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:23:54 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:23:54 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:23:54 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:54 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:23:54 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:54 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (27; unit: kubernetes-master/2) hook for tf-kubernetes-master/0 2024-09-18 14:23:54 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (27; unit: kubernetes-master/2) hook) 2024-09-18 14:23:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (27; unit: kubernetes-master/2) hook) 2024-09-18 14:23:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (27; unit: kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (27; unit: kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:56 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-joined hook for kubernetes-master/2 2024-09-18 14:23:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:56 INFO juju.worker.uniter.operation runhook.go:162 skipped "kube-api-endpoint-relation-joined" hook (missing) 2024-09-18 14:23:56 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (27; unit: kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:56 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:56 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (27; unit: kubernetes-master/2) hook) 2024-09-18 14:23:56 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:23:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:23:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:23:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:23:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (23; unit: tf-controller/2) hook for tf-kubernetes-master/0 2024-09-18 14:23:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/2) hook) 2024-09-18 14:23:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/2) hook) 2024-09-18 14:23:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:57 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-joined hook for tf-controller/2 2024-09-18 14:23:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:57 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:23:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/2) hook) 2024-09-18 14:23:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:23:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:23:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/0 2024-09-18 14:23:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:23:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:23:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:59 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2 2024-09-18 14:23:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:23:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:23:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:23:59 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:23:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:23:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:23:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:23:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:23:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:23:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/0) hook for tf-kubernetes-master/0 2024-09-18 14:23:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook) 2024-09-18 14:24:00 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {18 {map[tf-kubernetes-master/1:{1}] map[] []}} 2024-09-18 14:24:00 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{4}] map[] []}} 2024-09-18 14:24:01 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook) 2024-09-18 14:24:01 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-18 14:24:01 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-18 14:24:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/0 2024-09-18 14:24:01 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:24:02 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:24:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-18 14:24:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:24:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook) 2024-09-18 14:24:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:24:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:24:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:24:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:24:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (18; unit: tf-kubernetes-master/1) hook for tf-kubernetes-master/0 2024-09-18 14:24:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/1) hook) 2024-09-18 14:24:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/1) hook) 2024-09-18 14:24:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/0 2024-09-18 14:24:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/0 2024-09-18 14:24:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-changed hook for tf-kubernetes-master/1 2024-09-18 14:24:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:24:25 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: Peer relation changed with tf-kubernetes-master/1: {'egress-subnets': '10.0.0.23/32', 'ingress-address': '10.0.0.23', 'private-address': '10.0.0.23', 'unit-address': '10.0.0.23'} 2024-09-18 14:24:25 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: Cluster info: {'tf-kubernetes-master/0': '10.0.0.53', 'tf-kubernetes-master/1': '10.0.0.23'} 2024-09-18 14:24:25 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:24:25 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:24:25 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: ZIU: stage from relation None 2024-09-18 14:24:25 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:24:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (18; unit: tf-kubernetes-master/1) hook" for tf-kubernetes-master/0 2024-09-18 14:24:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:24:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/1) hook) 2024-09-18 14:24:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:24:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:24:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (27; unit: kubernetes-master/2) hook for tf-kubernetes-master/0 2024-09-18 14:24:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (27; unit: kubernetes-master/2) hook) 2024-09-18 14:24:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (27; unit: kubernetes-master/2) hook) 2024-09-18 14:24:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (27; unit: kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:24:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (27; unit: kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:24:27 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-changed hook for kubernetes-master/2 2024-09-18 14:24:27 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:24:28 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kube-api-endpoint:27: Can't get secret for token: Incorrect padding 2024-09-18 14:24:28 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kube-api-endpoint:27: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:24:28 INFO juju.worker.uniter.operation runhook.go:159 ran "kube-api-endpoint-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:24:28 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (27; unit: kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:24:28 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:24:28 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (27; unit: kubernetes-master/2) hook) 2024-09-18 14:24:28 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:24:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:24:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:24:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:24:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:24:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:24:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:24:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:24:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/0 2024-09-18 14:24:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:24:29 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{5}] map[] []}} 2024-09-18 14:24:29 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{3}] map[] []}} 2024-09-18 14:24:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:24:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:24:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:24:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2 2024-09-18 14:24:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:24:30 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:24:30 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:24:30 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:24:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:24:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:24:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:24:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:24:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:24:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:24:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:24:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:24:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:24:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:24:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:24:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:24:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:24:37 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 14:25:07 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{2}] map[] []}} 2024-09-18 14:25:15 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{3}] map[] []}} 2024-09-18 14:25:16 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {18 {map[tf-kubernetes-master/2:{1}] map[] []}} 2024-09-18 14:25:23 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{4}] map[] []}} 2024-09-18 14:25:33 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{5}] map[] []}} 2024-09-18 14:25:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:25:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:25:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:25:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1 2024-09-18 14:25:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:25:47 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:25:47 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'cloud_orchestrator': None, 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:25:48 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:25:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:25:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:25:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:25:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:25:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:25:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:25:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:25:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:25:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (18; unit: tf-kubernetes-master/2) hook for tf-kubernetes-master/0 2024-09-18 14:25:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/2) hook) 2024-09-18 14:25:48 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{6}] map[] []}} 2024-09-18 14:25:56 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{6}] map[] []}} 2024-09-18 14:25:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/2) hook) 2024-09-18 14:25:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (18; unit: tf-kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:25:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (18; unit: tf-kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:25:59 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-changed hook for tf-kubernetes-master/2 2024-09-18 14:25:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:25:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: Peer relation changed with tf-kubernetes-master/2: {'egress-subnets': '10.0.0.61/32', 'ingress-address': '10.0.0.61', 'private-address': '10.0.0.61', 'unit-address': '10.0.0.61'} 2024-09-18 14:25:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: Cluster info: {'tf-kubernetes-master/0': '10.0.0.53', 'tf-kubernetes-master/1': '10.0.0.23', 'tf-kubernetes-master/2': '10.0.0.61'} 2024-09-18 14:25:59 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:25:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'cloud_orchestrator': None, 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:25:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kubernetes-master-cluster:18: ZIU: stage from relation None 2024-09-18 14:25:59 INFO juju.worker.uniter.operation runhook.go:159 ran "kubernetes-master-cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:25:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (18; unit: tf-kubernetes-master/2) hook" for tf-kubernetes-master/0 2024-09-18 14:25:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:25:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (18; unit: tf-kubernetes-master/2) hook) 2024-09-18 14:25:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:25:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:25:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:25:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:25:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:25:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:25:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:25:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:25:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:25:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:01 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:01 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:02 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:26:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:02 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:26:02 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:26:02 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:26:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:26:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:26:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:26:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/0 2024-09-18 14:26:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:26:03 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{7}] map[] []}} 2024-09-18 14:26:03 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:26:03 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:26:03 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:26:03 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2 2024-09-18 14:26:03 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:03 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:26:03 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:26:04 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:26:04 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:26:04 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:04 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:26:04 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/0) hook for tf-kubernetes-master/0 2024-09-18 14:26:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook) 2024-09-18 14:26:05 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{4}] map[] []}} 2024-09-18 14:26:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook) 2024-09-18 14:26:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/0 2024-09-18 14:26:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:06 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:26:06 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:26:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook) 2024-09-18 14:26:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:26:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:26:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:26:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:26:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:26:06 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:26:06 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:07 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:26:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:07 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:26:07 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:26:08 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:26:08 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:08 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:26:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:26:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:26:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:26:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:26:08 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:26:08 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:26:09 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:26:09 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:26:09 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:26:09 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1 2024-09-18 14:26:09 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:09 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:26:09 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'cloud_orchestrator': None, 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:26:10 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:26:10 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:26:10 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:10 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:26:10 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:10 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:26:10 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/1) hook for tf-kubernetes-master/0 2024-09-18 14:26:10 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook) 2024-09-18 14:26:10 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{8}] map[] []}} 2024-09-18 14:26:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook) 2024-09-18 14:26:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-18 14:26:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-18 14:26:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/1 2024-09-18 14:26:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:12 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{9}] map[] []}} 2024-09-18 14:26:12 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:26:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-18 14:26:12 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:12 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook) 2024-09-18 14:26:12 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:26:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:26:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:26:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:26:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:26:12 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:26:12 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:14 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{5}] map[] []}} 2024-09-18 14:26:14 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{10}] map[] []}} 2024-09-18 14:26:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:14 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:14 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:26:14 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:14 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:26:14 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:26:14 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:26:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:14 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/1) hook for tf-kubernetes-master/0 2024-09-18 14:26:14 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook) 2024-09-18 14:26:15 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{7}] map[] []}} 2024-09-18 14:26:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook) 2024-09-18 14:26:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-18 14:26:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-18 14:26:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/1 2024-09-18 14:26:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:16 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:26:16 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:26:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-18 14:26:16 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{6}] map[] []}} 2024-09-18 14:26:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook) 2024-09-18 14:26:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:26:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:26:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:26:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:26:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:26:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:26:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:17 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{8}] map[] []}} 2024-09-18 14:26:29 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{11}] map[] []}} 2024-09-18 14:26:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:26:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:26:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:26:30 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:26:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:26:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:26:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:26:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:26:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/2) hook for tf-kubernetes-master/0 2024-09-18 14:26:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/2) hook) 2024-09-18 14:26:43 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{7}] map[] []}} 2024-09-18 14:26:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/2) hook) 2024-09-18 14:26:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/0 2024-09-18 14:26:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/0 2024-09-18 14:26:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/2 2024-09-18 14:26:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:26:49 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:26:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/0 2024-09-18 14:26:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:26:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/2) hook) 2024-09-18 14:26:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:26:49 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:26:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/2) hook for tf-kubernetes-master/0 2024-09-18 14:26:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/2) hook) 2024-09-18 14:26:57 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{9}] map[] []}} 2024-09-18 14:27:06 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/2) hook) 2024-09-18 14:27:06 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/0 2024-09-18 14:27:06 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/0 2024-09-18 14:27:06 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/2 2024-09-18 14:27:06 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:27:06 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:27:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/2) hook" for tf-kubernetes-master/0 2024-09-18 14:27:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:27:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/2) hook) 2024-09-18 14:27:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:27:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:27:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:27:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:27:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:27:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:27:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:27:06 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:27:06 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:27:07 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:27:09 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{12}] map[] []}} 2024-09-18 14:27:35 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{10}] map[] []}} 2024-09-18 14:27:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:27:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:27:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:27:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:27:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:27:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:27:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:27:47 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:27:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:27:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:27:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:27:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:27:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:27:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:27:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:27:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:27:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/3) hook for tf-kubernetes-master/0 2024-09-18 14:27:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/3) hook) 2024-09-18 14:27:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/3) hook) 2024-09-18 14:27:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/0 2024-09-18 14:27:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/0 2024-09-18 14:27:57 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/3 2024-09-18 14:27:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:27:57 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:27:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/0 2024-09-18 14:27:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:27:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/3) hook) 2024-09-18 14:27:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:27:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:27:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:27:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:27:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:27:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:27:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:28:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:28:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:28:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:28:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:28:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:28:05 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:28:05 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:28:05 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:28:05 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:28:05 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:28:05 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:28:05 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:28:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:28:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:28:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:28:06 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:28:06 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:28:06 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:28:06 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1 2024-09-18 14:28:06 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:28:06 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:28:06 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:28:08 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:28:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:28:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:28:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:28:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:28:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:28:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/3) hook for tf-kubernetes-master/0 2024-09-18 14:28:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/3) hook) 2024-09-18 14:28:23 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{11}] map[] []}} 2024-09-18 14:28:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/3) hook) 2024-09-18 14:28:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/0 2024-09-18 14:28:24 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/0 2024-09-18 14:28:24 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/3 2024-09-18 14:28:24 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:28:24 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:28:24 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:28:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/3) hook" for tf-kubernetes-master/0 2024-09-18 14:28:24 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:28:24 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/3) hook) 2024-09-18 14:28:24 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:28:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:28:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:28:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:28:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:28:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:28:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:28:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:28:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/0 2024-09-18 14:28:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:28:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:28:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:28:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:28:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2 2024-09-18 14:28:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:28:25 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:28:25 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:28:25 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:28:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:28:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:28:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:28:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:28:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:28:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/4) hook for tf-kubernetes-master/0 2024-09-18 14:28:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/4) hook) 2024-09-18 14:28:32 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{13}] map[] []}} 2024-09-18 14:28:34 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{12}] map[] []}} 2024-09-18 14:28:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/4) hook) 2024-09-18 14:28:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/0 2024-09-18 14:28:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/0 2024-09-18 14:28:34 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/4 2024-09-18 14:28:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:28:34 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:28:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/0 2024-09-18 14:28:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:28:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/4) hook) 2024-09-18 14:28:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:28:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:28:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/4) hook for tf-kubernetes-master/0 2024-09-18 14:28:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/4) hook) 2024-09-18 14:28:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/4) hook) 2024-09-18 14:28:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/0 2024-09-18 14:28:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/0 2024-09-18 14:28:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/4 2024-09-18 14:28:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:28:35 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:28:36 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:28:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/4) hook" for tf-kubernetes-master/0 2024-09-18 14:28:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:28:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/4) hook) 2024-09-18 14:28:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:28:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:28:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:28:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:28:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:28:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:28:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:28:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:28:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:28:36 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:28:36 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:28:37 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:28:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:28:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:28:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:28:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:28:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:28:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:28:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/0 2024-09-18 14:28:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:28:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:28:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:28:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:28:44 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2 2024-09-18 14:28:44 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{13}] map[] []}} 2024-09-18 14:28:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:28:44 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:28:44 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:28:44 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:28:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:28:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:28:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:28:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:28:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:28:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:28:45 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/0 2024-09-18 14:28:45 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:28:45 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{14}] map[] []}} 2024-09-18 14:28:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:28:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:28:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:28:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:28:51 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{14}] map[] []}} 2024-09-18 14:28:51 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:28:51 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:28:51 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:28:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:28:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:28:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:28:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:28:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:28:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:28:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:28:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:28:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:28:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:29:03 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 14:29:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:29:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:29:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:29:19 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:29:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:29:20 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:29:20 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:29:20 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{15}] map[] []}} 2024-09-18 14:29:20 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:29:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:29:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:29:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:29:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:29:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:29:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/0 2024-09-18 14:29:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:29:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:29:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:29:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:29:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2 2024-09-18 14:29:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:29:25 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:29:25 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:29:25 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:29:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:29:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:29:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:29:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:29:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:29:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:29:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:29:31 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{8}] map[] []}} 2024-09-18 14:29:31 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:29:31 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:29:31 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:29:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:29:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:29:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:29:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1 2024-09-18 14:29:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:29:36 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:29:36 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:29:36 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:29:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:29:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:29:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:29:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:29:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:29:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:29:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:29:46 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{9}] map[] []}} 2024-09-18 14:29:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:29:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:29:46 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:29:46 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:29:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:29:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:29:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:29:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1 2024-09-18 14:29:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:29:47 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:29:47 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:29:47 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:29:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:29:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:29:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:29:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:29:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:29:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:29:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:30:03 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{10}] map[] []}} 2024-09-18 14:30:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:30:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:30:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:30:07 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{11}] map[] []}} 2024-09-18 14:30:10 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:30:10 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:30:10 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:30:10 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1 2024-09-18 14:30:10 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:30:10 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:30:10 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:30:10 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:30:10 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:30:10 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:30:10 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:30:10 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:30:10 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:30:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:30:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:30:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:30:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:30:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:30:10 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:30:10 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:30:10 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:30:10 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:30:10 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:30:10 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:30:10 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:30:10 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:30:11 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:30:11 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:30:11 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:30:11 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:30:11 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:30:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:30:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:30:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:30:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:34:36 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 14:34:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:34:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:34:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 14:34:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:34:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:34:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:34:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:34:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:34:39 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-18 14:34:39 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 14:34:39 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:34:39 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 14:34:39 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Writing file /etc/contrail/common_kubemanager.env root:root 600 2024-09-18 14:34:39 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has been created and is not logged. 2024-09-18 14:34:39 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 14:34:39 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Making dir /etc/contrail/contrail-kubernetes-master root:root 755 2024-09-18 14:34:39 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Writing file /etc/contrail/contrail-kubernetes-master/docker-compose.yaml root:root 600 2024-09-18 14:34:39 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has been created and is not logged. 2024-09-18 14:34:40 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 Creating contrail-kubernetes-master_node-init_1 ... 2024-09-18 14:34:40 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60  Creating contrail-kubernetes-master_node-init_1 ... done Creating contrail-kubernetes-master_kubemanager_1 ... 2024-09-18 14:34:42 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:34:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:34:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:34:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:34:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:34:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:34:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:34:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:34:48 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{15}] map[] []}} 2024-09-18 14:34:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:34:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:34:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:34:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:34:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:34:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:34:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:34:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-18 14:34:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:34:49 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/1:{12}] map[] []}} 2024-09-18 14:34:53 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/2:{16}] map[] []}} 2024-09-18 14:35:01 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:35:01 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:35:01 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:35:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-18 14:35:01 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:35:01 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:35:01 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:35:01 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 14:35:01 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-09-18 14:35:01 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-09-18 14:35:01 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 14:35:01 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-09-18 14:35:01 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-09-18 14:35:01 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Services actual count: 2, required count: 2 2024-09-18 14:35:03 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 14:35:03 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 data = yaml.load(fh) 2024-09-18 14:35:03 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:35:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-18 14:35:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:35:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-18 14:35:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:35:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:35:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:35:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:35:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:35:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:35:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:35:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/1) hook for tf-kubernetes-master/0 2024-09-18 14:35:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:35:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:35:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:35:14 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:35:14 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/1 2024-09-18 14:35:14 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:35:14 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:35:14 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:35:14 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 14:35:14 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-09-18 14:35:14 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-09-18 14:35:14 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 14:35:14 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-09-18 14:35:14 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-09-18 14:35:15 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Services actual count: 2, required count: 2 2024-09-18 14:35:17 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 14:35:17 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 data = yaml.load(fh) 2024-09-18 14:35:17 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:35:17 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/1) hook" for tf-kubernetes-master/0 2024-09-18 14:35:17 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:35:17 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/1) hook) 2024-09-18 14:35:17 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:35:17 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:35:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:35:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:35:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:35:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:35:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:35:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:35:17 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/2) hook for tf-kubernetes-master/0 2024-09-18 14:35:17 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:35:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:35:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:35:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:35:23 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/2 2024-09-18 14:35:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:35:23 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-18 14:35:23 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:35:23 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 14:35:23 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-09-18 14:35:23 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-09-18 14:35:23 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 14:35:23 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-09-18 14:35:23 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-09-18 14:35:24 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Services actual count: 2, required count: 2 2024-09-18 14:35:25 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 14:35:25 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 data = yaml.load(fh) 2024-09-18 14:35:26 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:35:26 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/2) hook" for tf-kubernetes-master/0 2024-09-18 14:35:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:35:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/2) hook) 2024-09-18 14:35:26 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:35:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:35:26 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:35:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:35:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:39:11 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 14:39:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:39:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:39:11 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 14:39:11 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:39:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:39:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:39:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:39:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:39:11 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 14:39:11 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:39:11 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 14:39:11 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 14:39:11 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 14:39:11 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 14:39:11 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 14:39:11 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 14:39:11 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 14:39:13 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 14:39:13 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 14:39:13 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:39:13 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:39:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:39:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:39:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:39:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:39:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:45:00 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 14:45:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:45:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:45:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 14:45:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:45:00 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:45:00 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:45:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:45:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:45:00 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 14:45:00 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:45:00 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 14:45:00 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 14:45:00 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 14:45:00 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 14:45:00 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 14:45:00 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 14:45:00 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 14:45:02 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 14:45:02 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 14:45:02 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:45:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:45:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:45:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:45:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:45:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:50:35 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 14:50:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:50:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 14:50:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:50:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:50:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:50:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:50:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:50:35 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 14:50:35 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:50:35 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 14:50:35 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 14:50:35 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 14:50:35 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 14:50:35 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 14:50:35 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 14:50:35 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 14:50:38 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 14:50:38 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 14:50:38 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:50:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:50:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:50:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:50:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:50:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:50:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:55:56 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 14:55:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:55:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:55:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 14:55:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:55:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:55:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:55:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:55:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 14:55:56 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 14:55:56 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 14:55:56 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 14:55:56 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 14:55:56 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 14:55:56 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 14:55:56 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 14:55:56 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 14:55:56 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 14:55:59 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 14:55:59 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 14:55:59 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:55:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 14:55:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:55:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 14:55:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 14:55:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 14:55:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:00:46 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 15:00:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:00:46 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 15:00:46 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:00:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:00:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:00:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:00:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 15:00:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 15:00:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 15:00:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 15:00:46 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:00:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:00:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 15:00:46 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:00:46 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:00:46 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 15:00:48 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 15:00:48 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 15:00:49 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:00:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:00:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:00:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:00:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 15:00:49 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:00:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:04:54 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 15:04:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:04:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:04:54 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 15:04:54 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:04:54 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:04:54 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:04:54 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:04:54 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 15:04:54 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 15:04:54 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 15:04:54 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 15:04:54 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:04:54 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:04:54 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 15:04:54 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:04:54 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:04:55 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 15:04:57 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 15:04:57 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 15:04:57 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:04:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:04:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:04:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:04:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 15:04:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:04:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:09:43 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 15:09:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:09:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 15:09:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:09:43 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:09:43 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:09:43 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:09:43 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 15:09:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 15:09:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 15:09:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 15:09:43 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:09:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:09:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 15:09:43 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:09:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:09:43 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 15:09:45 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 15:09:45 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 15:09:45 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:09:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:09:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:09:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:09:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 15:09:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:09:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:15:15 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 15:15:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:15:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:15:15 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 15:15:15 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:15:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:15:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:15:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:15:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 15:15:21 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 15:15:21 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 15:15:21 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 15:15:21 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:15:21 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:15:21 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 15:15:21 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:15:21 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:15:21 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 15:15:24 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 15:15:24 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 15:15:24 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:15:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:15:24 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:15:24 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:15:24 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 15:15:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:15:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:20:26 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 15:20:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:20:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:20:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 15:20:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:20:26 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:20:26 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:20:26 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:20:26 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 15:20:26 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 15:20:26 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 15:20:26 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 15:20:26 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:20:26 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:20:26 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 15:20:26 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:20:26 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:20:26 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 15:20:28 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 15:20:28 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 15:20:28 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:20:28 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:20:28 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:20:28 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:20:28 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 15:20:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:24:42 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-18 15:24:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:24:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:24:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-18 15:24:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:24:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:24:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:24:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:24:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-18 15:24:48 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-18 15:24:48 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_0_4_6-1', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.53', '10.0.0.23', '10.0.0.61'], 'controller_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'control_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'analytics_servers': ['10.0.0.61', '10.0.0.23', '10.0.0.53'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlNIWHZhb0cxSmgzaU1IZTBBMnZySVBrVm5UMWU3Z0lNbEpzYmZ4aHEtV1EifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjZiZDdmM2I2LTFiNTItNDBmYS05OTZmLWYwMmJiZjU2NmVhMiIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.EvIAMMXi5OR-FUXseEdXjD8a29tL-u1bMWZJJIpx-53wqqsbt0W_XVeE_fgkYtwU8wyFPQ-9gh-hPW9Un6KUhMnirwrCFckhH3PeI3tByV7Rdo331Y34KNZz64by2q7lyxR1SCWt94l79A9l77v610yNhdnk7gU3nrZKafAb1Y1nHtiTX_OwxNAzz84sFLpcSsipRnXk_eZ8p23_4SHrnR0_L8-M5mOkB_9xnDSt7xrqoIq9OTUPhUvcvfdfp-iSsBUeyQ0FxEhtV4MZHALPfR3maEV-tPon9S8JSq9xqR03JIQjoO4CvuyPeOk87rNB5syTzl7WpO1hORXO1SojKA', 'kubernetes_api_server': '10.0.0.53', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-18 15:24:48 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-18 15:24:48 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:24:48 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:24:48 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-18 15:24:48 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-18 15:24:48 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-18 15:24:48 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-18 15:24:50 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-18 15:24:50 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-18 15:24:50 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:24:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-18 15:24:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:24:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-18 15:24:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-18 15:24:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/1" already joined relation 18 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-master/2" already joined relation 18 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/1" already joined relation 23 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/2" already joined relation 23 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/2" already joined relation 24 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/3" already joined relation 24 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/4" already joined relation 24 2024-09-18 15:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 27