2025-04-15 15:17:48 INFO juju unit_agent.go:289 Starting unit workers for "tf-analyticsdb/0" 2025-04-15 15:17:48 INFO juju.worker.apicaller connect.go:163 [514961] "unit-tf-analyticsdb-0" successfully connected to "10.0.0.41:17070" 2025-04-15 15:17:48 INFO juju.worker.apicaller connect.go:260 [514961] password changed for "unit-tf-analyticsdb-0" 2025-04-15 15:17:48 INFO juju.worker.apicaller connect.go:163 [514961] "unit-tf-analyticsdb-0" successfully connected to "252.41.0.1:17070" 2025-04-15 15:17:48 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2025-04-15 15:17:48 INFO juju.worker.logger logger.go:120 logger worker started 2025-04-15 15:17:48 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2025-04-15 15:17:48.149174854 +0000 UTC 2025-04-15 15:17:48 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2025-04-15 15:17:48.157228532 +0000 UTC 2025-04-15 15:17:48 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2025-04-15 15:17:48.158365555 +0000 UTC 2025-04-15 15:17:48 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-04-15 15:17:48 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.41:17070 252.41.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2025-04-15 15:17:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2025-04-15 15:17:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2025-04-15 15:17:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:17:48 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2025-04-15 15:17:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:17:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2025-04-15 15:17:48 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2025-04-15 15:17:48 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2025-04-15 15:17:48 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-tf-analyticsdb-0/run.socket } 2025-04-15 15:17:48 INFO juju.worker.uniter uniter.go:335 unit "tf-analyticsdb/0" started 2025-04-15 15:17:48 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2025-04-15 15:17:48 INFO juju.worker.uniter uniter.go:651 resuming charm install 2025-04-15 15:17:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation install local:jammy/contrail-analyticsdb-0 for tf-analyticsdb/0 2025-04-15 15:17:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install local:jammy/contrail-analyticsdb-0" for tf-analyticsdb/0 2025-04-15 15:17:48 INFO juju.worker.uniter.charm bundles.go:81 downloading local:jammy/contrail-analyticsdb-0 from API server 2025-04-15 15:17:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install local:jammy/contrail-analyticsdb-0" for tf-analyticsdb/0 2025-04-15 15:17:48 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "local:jammy/contrail-analyticsdb-0" 2025-04-15 15:17:48 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "local:jammy/contrail-analyticsdb-0" 2025-04-15 15:17:49 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "local:jammy/contrail-analyticsdb-0" 2025-04-15 15:17:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install local:jammy/contrail-analyticsdb-0" for tf-analyticsdb/0 2025-04-15 15:17:49 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for tf-analyticsdb/0 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for tf-analyticsdb/0: ok=true, hashes=[6cee67333b32bd433de85c3b2ce141fb2304ca45af0d248b8d56df21ffb9e00e] 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for tf-analyticsdb/0: ok=true, hashes=[da45b40c2a48905a2608066d13de377b117800eeb94c7a6ae0412466f132ae87] 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for tf-analyticsdb/0: ok=true, hashes=[8e1d260028a315059737a2097896046da018c71d734dea09c8a86ad932dabffc] 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for tf-analyticsdb/0: [] ok=true 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-analyticsdb/0: ok=true 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for tf-analyticsdb/0: ok=true 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for tf-analyticsdb/0 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for tf-analyticsdb/0: ok=true 2025-04-15 15:17:49 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for tf-analyticsdb/0: [] ok=true 2025-04-15 15:17:49 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2025-04-15 15:17:49 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2025-04-15 15:17:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for tf-analyticsdb/0 2025-04-15 15:17:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run install hook) 2025-04-15 15:18:20 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-analyticsdb/0 : {55 {map[tf-analytics/0:{0}] map[] []}} 2025-04-15 15:22:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run install hook) 2025-04-15 15:22:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for tf-analyticsdb/0 2025-04-15 15:22:14 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for tf-analyticsdb/0 2025-04-15 15:22:14 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2025-04-15 15:22:14 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:22:15 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Installing logrotate with options: ['--option=Dpkg::Options::=--force-confold'] 2025-04-15 15:22:15 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Reading package lists... 2025-04-15 15:22:15 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Building dependency tree... 2025-04-15 15:22:15 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Reading state information... 2025-04-15 15:22:15 DEBUG unit.tf-analyticsdb/0.install logger.go:60 logrotate is already the newest version (3.19.0-1ubuntu1.1). 2025-04-15 15:22:15 DEBUG unit.tf-analyticsdb/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 8 not upgraded. 2025-04-15 15:22:15 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Installing ['apt-transport-https', 'ca-certificates', 'curl', 'software-properties-common'] with options: ['--option=Dpkg::Options::=--force-confold'] 2025-04-15 15:22:15 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Reading package lists... 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Building dependency tree... 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Reading state information... 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 ca-certificates is already the newest version (20240203~22.04.1). 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 curl is already the newest version (7.81.0-1ubuntu1.20). 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 software-properties-common is already the newest version (0.99.22.9). 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 apt-transport-https is already the newest version (2.4.14). 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 8 not upgraded. 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy InRelease 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-security InRelease 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates InRelease 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-proposed InRelease 2025-04-15 15:22:16 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Hit:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-backports InRelease 2025-04-15 15:22:16 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-analyticsdb/0 : {59 {map[easyrsa/0:{0}] map[] []}} 2025-04-15 15:22:18 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Reading package lists... 2025-04-15 15:22:18 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Installing docker.io with options: ['--option=Dpkg::Options::=--force-confold'] 2025-04-15 15:22:18 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Reading package lists... 2025-04-15 15:22:18 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Building dependency tree... 2025-04-15 15:22:18 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Reading state information... 2025-04-15 15:22:18 DEBUG unit.tf-analyticsdb/0.install logger.go:60 docker.io is already the newest version (26.1.3-0ubuntu1~22.04.1). 2025-04-15 15:22:18 DEBUG unit.tf-analyticsdb/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 8 not upgraded. 2025-04-15 15:22:18 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Installing ['docker-compose'] with options: ['--option=Dpkg::Options::=--force-confold'] 2025-04-15 15:22:18 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Reading package lists... 2025-04-15 15:22:19 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Building dependency tree... 2025-04-15 15:22:19 DEBUG unit.tf-analyticsdb/0.install logger.go:60 Reading state information... 2025-04-15 15:22:19 DEBUG unit.tf-analyticsdb/0.install logger.go:60 docker-compose is already the newest version (1.29.2-1). 2025-04-15 15:22:19 DEBUG unit.tf-analyticsdb/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 8 not upgraded. 2025-04-15 15:22:19 DEBUG unit.tf-analyticsdb/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2025-04-15 15:22:21 INFO unit.tf-analyticsdb/0.juju-log server.go:316 analytics_ips is not in config. calculating... 2025-04-15 15:22:21 INFO unit.tf-analyticsdb/0.juju-log server.go:316 CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': False, 'certs_hash': '', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'cloud_orchestrators': [], 'analyticsdb_servers': [], 'controller_servers': [], 'control_servers': [], 'analytics_servers': []} 2025-04-15 15:22:21 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2025-04-15 15:22:21 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for tf-analyticsdb/0 2025-04-15 15:22:21 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:22:21 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run install hook) 2025-04-15 15:22:21 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:22:21 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-analyticsdb/0" (leader=true) entered scope for relation "tf-controller:contrail-analyticsdb tf-analyticsdb:contrail-analyticsdb" 2025-04-15 15:22:21 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-analyticsdb/0" (leader=true) entered scope for relation "tf-analytics:contrail-analyticsdb tf-analyticsdb:contrail-analyticsdb" 2025-04-15 15:22:21 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-analyticsdb/0" (leader=true) entered scope for relation "tf-analyticsdb:tls-certificates easyrsa:client" 2025-04-15 15:22:21 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-analyticsdb/0" (leader=true) entered scope for relation "tf-analyticsdb:analyticsdb-cluster" 2025-04-15 15:22:21 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (54; app: tf-controller) hook for tf-analyticsdb/0 2025-04-15 15:22:21 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-created (54; app: tf-controller) hook) 2025-04-15 15:22:30 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-analyticsdb/0 2025-04-15 15:22:30 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-analyticsdb/0 : {54 {map[tf-controller/0:{0}] map[] []}} 2025-04-15 15:22:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-created (54; app: tf-controller) hook) 2025-04-15 15:22:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (54; app: tf-controller) hook" for tf-analyticsdb/0 2025-04-15 15:22:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (54; app: tf-controller) hook" for tf-analyticsdb/0 2025-04-15 15:22:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-analyticsdb-relation-created hook 2025-04-15 15:22:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:22:37 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-analyticsdb-relation-created" hook (missing) 2025-04-15 15:22:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (54; app: tf-controller) hook" for tf-analyticsdb/0 2025-04-15 15:22:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:22:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-created (54; app: tf-controller) hook) 2025-04-15 15:22:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:22:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (50; app: tf-analyticsdb) hook for tf-analyticsdb/0 2025-04-15 15:22:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-created (50; app: tf-analyticsdb) hook) 2025-04-15 15:22:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-created (50; app: tf-analyticsdb) hook) 2025-04-15 15:22:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (50; app: tf-analyticsdb) hook" for tf-analyticsdb/0 2025-04-15 15:22:50 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (50; app: tf-analyticsdb) hook" for tf-analyticsdb/0 2025-04-15 15:22:50 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running analyticsdb-cluster-relation-created hook 2025-04-15 15:22:50 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:22:50 INFO juju.worker.uniter.operation runhook.go:162 skipped "analyticsdb-cluster-relation-created" hook (missing) 2025-04-15 15:22:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (50; app: tf-analyticsdb) hook" for tf-analyticsdb/0 2025-04-15 15:22:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:22:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-created (50; app: tf-analyticsdb) hook) 2025-04-15 15:22:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:22:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (59; app: easyrsa) hook for tf-analyticsdb/0 2025-04-15 15:22:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-created (59; app: easyrsa) hook) 2025-04-15 15:23:00 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-created (59; app: easyrsa) hook) 2025-04-15 15:23:00 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (59; app: easyrsa) hook" for tf-analyticsdb/0 2025-04-15 15:23:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (59; app: easyrsa) hook" for tf-analyticsdb/0 2025-04-15 15:23:00 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running tls-certificates-relation-created hook 2025-04-15 15:23:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:23:00 INFO juju.worker.uniter.operation runhook.go:162 skipped "tls-certificates-relation-created" hook (missing) 2025-04-15 15:23:00 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (59; app: easyrsa) hook" for tf-analyticsdb/0 2025-04-15 15:23:00 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:23:00 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-created (59; app: easyrsa) hook) 2025-04-15 15:23:00 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:23:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (55; app: tf-analytics) hook for tf-analyticsdb/0 2025-04-15 15:23:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-created (55; app: tf-analytics) hook) 2025-04-15 15:23:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-created (55; app: tf-analytics) hook) 2025-04-15 15:23:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (55; app: tf-analytics) hook" for tf-analyticsdb/0 2025-04-15 15:23:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (55; app: tf-analytics) hook" for tf-analyticsdb/0 2025-04-15 15:23:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-analyticsdb-relation-created hook 2025-04-15 15:23:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:23:16 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-analyticsdb-relation-created" hook (missing) 2025-04-15 15:23:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (55; app: tf-analytics) hook" for tf-analyticsdb/0 2025-04-15 15:23:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:23:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-created (55; app: tf-analytics) hook) 2025-04-15 15:23:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:23:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for tf-analyticsdb/0 2025-04-15 15:23:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for tf-analyticsdb/0 2025-04-15 15:23:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for tf-analyticsdb/0 2025-04-15 15:23:16 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2025-04-15 15:23:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for tf-analyticsdb/0 2025-04-15 15:23:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run leader-elected hook) 2025-04-15 15:23:31 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-analyticsdb/0 : {55 {map[tf-analytics/0:{1}] map[] []}} 2025-04-15 15:23:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run leader-elected hook) 2025-04-15 15:23:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for tf-analyticsdb/0 2025-04-15 15:23:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for tf-analyticsdb/0 2025-04-15 15:23:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2025-04-15 15:23:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:23:33 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Cluster current info: {'tf-analyticsdb/0': '10.0.0.41'} 2025-04-15 15:23:33 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Cluster saved info: {} 2025-04-15 15:23:33 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Cluster info: {'tf-analyticsdb/0': '10.0.0.41'} 2025-04-15 15:23:33 INFO unit.tf-analyticsdb/0.juju-log server.go:316 analytics_ips is not in config. calculating... 2025-04-15 15:23:33 INFO unit.tf-analyticsdb/0.juju-log server.go:316 CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': False, 'certs_hash': '', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'cloud_orchestrators': [], 'analyticsdb_servers': ['10.0.0.41'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': []} 2025-04-15 15:23:33 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-analyticsdb/0: ok=true 2025-04-15 15:23:33 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2025-04-15 15:23:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for tf-analyticsdb/0 2025-04-15 15:23:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:23:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run leader-elected hook) 2025-04-15 15:23:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:23:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:23:33 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for tf-analyticsdb/0 2025-04-15 15:23:33 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run config-changed hook) 2025-04-15 15:24:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run config-changed hook) 2025-04-15 15:24:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for tf-analyticsdb/0 2025-04-15 15:24:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for tf-analyticsdb/0 2025-04-15 15:24:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2025-04-15 15:24:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:24:47 INFO unit.tf-analyticsdb/0.juju-log server.go:316 /usr/bin/rsync -r --executability /var/lib/juju/agents/unit-tf-analyticsdb-0/charm/files/plugins/ /usr/local/lib/nagios/plugins 2025-04-15 15:24:47 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Nagios user not set up, nrpe checks not updated 2025-04-15 15:24:47 INFO unit.tf-analyticsdb/0.juju-log server.go:316 analytics_ips is not in config. calculating... 2025-04-15 15:24:47 INFO unit.tf-analyticsdb/0.juju-log server.go:316 CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': False, 'certs_hash': '', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'cloud_orchestrators': [], 'analyticsdb_servers': ['10.0.0.41'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': []} 2025-04-15 15:24:47 WARNING unit.tf-analyticsdb/0.config-changed logger.go:60 Error: No such object: nexus.gz1.opensdn.io:5101/opensdn-analytics-query-engine:master-1_5_3_5-1 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 master-1_5_3_5-1: Pulling from opensdn-analytics-query-engine 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 2d473b07cdd5: Already exists 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 6a09441cf7fc: Already exists 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 31aed9522928: Already exists 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 775be17f40c1: Already exists 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 a95b5a9145f4: Already exists 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 68509b2b4dd8: Already exists 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 d8913b46d18c: Already exists 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 ee9eee0dda2d: Already exists 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 f5fb3b6c14c8: Already exists 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 7911714f088f: Pulling fs layer 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 985357682f0e: Pulling fs layer 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 7911714f088f: Verifying Checksum 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 7911714f088f: Download complete 2025-04-15 15:24:47 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 7911714f088f: Pull complete 2025-04-15 15:24:48 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 985357682f0e: Verifying Checksum 2025-04-15 15:24:48 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 985357682f0e: Download complete 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 985357682f0e: Pull complete 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 Digest: sha256:3e528bcb1e1f33363008070ecc7e79cd04e392bfe983d42b1988a60a05d408c1 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 Status: Downloaded newer image for nexus.gz1.opensdn.io:5101/opensdn-analytics-query-engine:master-1_5_3_5-1 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 nexus.gz1.opensdn.io:5101/opensdn-analytics-query-engine:master-1_5_3_5-1 2025-04-15 15:24:55 WARNING unit.tf-analyticsdb/0.config-changed logger.go:60 Error: No such object: nexus.gz1.opensdn.io:5101/opensdn-external-cassandra:master-1_5_3_5-1 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 master-1_5_3_5-1: Pulling from opensdn-external-cassandra 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 2d473b07cdd5: Already exists 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 6a09441cf7fc: Already exists 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 31aed9522928: Already exists 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 775be17f40c1: Already exists 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 a95b5a9145f4: Already exists 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 68509b2b4dd8: Already exists 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 d8913b46d18c: Already exists 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 8e146d6c86de: Pulling fs layer 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 a30c6e0daab8: Pulling fs layer 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 8e146d6c86de: Download complete 2025-04-15 15:24:55 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 8e146d6c86de: Pull complete 2025-04-15 15:24:57 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 a30c6e0daab8: Verifying Checksum 2025-04-15 15:24:57 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 a30c6e0daab8: Download complete 2025-04-15 15:25:02 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 a30c6e0daab8: Pull complete 2025-04-15 15:25:03 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 Digest: sha256:be2406c2f05e08ded51e09926e1403a422f87854d07ad2b40dc3343ec037a287 2025-04-15 15:25:03 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 Status: Downloaded newer image for nexus.gz1.opensdn.io:5101/opensdn-external-cassandra:master-1_5_3_5-1 2025-04-15 15:25:03 DEBUG unit.tf-analyticsdb/0.config-changed logger.go:60 nexus.gz1.opensdn.io:5101/opensdn-external-cassandra:master-1_5_3_5-1 2025-04-15 15:25:03 INFO unit.tf-analyticsdb/0.juju-log server.go:316 analytics_ips is not in config. calculating... 2025-04-15 15:25:03 INFO unit.tf-analyticsdb/0.juju-log server.go:316 CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': False, 'certs_hash': '', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'cloud_orchestrators': [], 'analyticsdb_servers': ['10.0.0.41'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': []} 2025-04-15 15:25:03 INFO unit.tf-analyticsdb/0.juju-log server.go:316 ZIU: stage from config None 2025-04-15 15:25:03 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2025-04-15 15:25:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for tf-analyticsdb/0 2025-04-15 15:25:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:25:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run config-changed hook) 2025-04-15 15:25:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:25:03 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2025-04-15 15:25:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for tf-analyticsdb/0 2025-04-15 15:25:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run start hook) 2025-04-15 15:25:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run start hook) 2025-04-15 15:25:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for tf-analyticsdb/0 2025-04-15 15:25:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for tf-analyticsdb/0 2025-04-15 15:25:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2025-04-15 15:25:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:25:05 INFO juju.worker.uniter.operation runhook.go:162 skipped "start" hook (missing) 2025-04-15 15:25:05 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for tf-analyticsdb/0 2025-04-15 15:25:05 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:25:05 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run start hook) 2025-04-15 15:25:05 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:25:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:25:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (54; unit: tf-controller/0) hook for tf-analyticsdb/0 2025-04-15 15:25:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-joined (54; unit: tf-controller/0) hook) 2025-04-15 15:25:05 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2025-04-15 15:25:05.566568089 +0000 UTC 2025-04-15 15:25:42 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-analyticsdb/0 : {59 {map[easyrsa/0:{1}] map[] []}} 2025-04-15 15:25:43 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-joined (54; unit: tf-controller/0) hook) 2025-04-15 15:25:43 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:25:43 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:25:43 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-analyticsdb-relation-joined hook for tf-controller/0 2025-04-15 15:25:43 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:25:43 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-analyticsdb-relation-joined" hook (via explicit, bespoke hook script) 2025-04-15 15:25:43 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:25:43 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:25:43 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-joined (54; unit: tf-controller/0) hook) 2025-04-15 15:25:43 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:25:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:25:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (59; unit: easyrsa/0) hook for tf-analyticsdb/0 2025-04-15 15:25:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-joined (59; unit: easyrsa/0) hook) 2025-04-15 15:25:44 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-analyticsdb/0 : {54 {map[tf-controller/0:{1}] map[] []}} 2025-04-15 15:25:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-joined (59; unit: easyrsa/0) hook) 2025-04-15 15:25:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (59; unit: easyrsa/0) hook" for tf-analyticsdb/0 2025-04-15 15:25:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (59; unit: easyrsa/0) hook" for tf-analyticsdb/0 2025-04-15 15:25:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running tls-certificates-relation-joined hook for easyrsa/0 2025-04-15 15:25:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:25:46 INFO unit.tf-analyticsdb/0.juju-log server.go:316 tls-certificates:59: TLS_CTX: {'sans': '["cn-jenkins-deploy-platform-juju-os-509-1", "10.0.0.41", "127.0.0.1"]', 'common_name': 'cn-jenkins-deploy-platform-juju-os-509-1', 'certificate_name': 'cn-jenkins-deploy-platform-juju-os-509-1'} 2025-04-15 15:25:46 INFO juju.worker.uniter.operation runhook.go:159 ran "tls-certificates-relation-joined" hook (via explicit, bespoke hook script) 2025-04-15 15:25:46 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (59; unit: easyrsa/0) hook" for tf-analyticsdb/0 2025-04-15 15:25:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:25:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-joined (59; unit: easyrsa/0) hook) 2025-04-15 15:25:46 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:25:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:25:46 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (54; unit: tf-controller/0) hook for tf-analyticsdb/0 2025-04-15 15:25:46 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-changed (54; unit: tf-controller/0) hook) 2025-04-15 15:26:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-changed (54; unit: tf-controller/0) hook) 2025-04-15 15:26:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-analyticsdb-relation-changed hook for tf-controller/0 2025-04-15 15:26:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:26:36 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: ZIU: stage from relation None 2025-04-15 15:26:36 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: analytics_ips is not in config. calculating... 2025-04-15 15:26:36 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': False, 'certs_hash': '', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'cloud_orchestrators': [], 'analyticsdb_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': []} 2025-04-15 15:26:36 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-analyticsdb-relation-changed" hook (via explicit, bespoke hook script) 2025-04-15 15:26:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:26:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-changed (54; unit: tf-controller/0) hook) 2025-04-15 15:26:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:26:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:26:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:26:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (55; unit: tf-analytics/0) hook for tf-analyticsdb/0 2025-04-15 15:26:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-joined (55; unit: tf-analytics/0) hook) 2025-04-15 15:26:39 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-joined (55; unit: tf-analytics/0) hook) 2025-04-15 15:26:39 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (55; unit: tf-analytics/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:39 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (55; unit: tf-analytics/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:39 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-analyticsdb-relation-joined hook for tf-analytics/0 2025-04-15 15:26:39 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:26:39 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-analyticsdb/0 : {59 {map[easyrsa/0:{2}] map[] []}} 2025-04-15 15:26:40 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-analyticsdb-relation-joined" hook (via explicit, bespoke hook script) 2025-04-15 15:26:40 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (55; unit: tf-analytics/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:40 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:26:40 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-joined (55; unit: tf-analytics/0) hook) 2025-04-15 15:26:40 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:26:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:26:40 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (59; unit: easyrsa/0) hook for tf-analyticsdb/0 2025-04-15 15:26:40 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-changed (59; unit: easyrsa/0) hook) 2025-04-15 15:26:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-changed (59; unit: easyrsa/0) hook) 2025-04-15 15:26:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (59; unit: easyrsa/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (59; unit: easyrsa/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running tls-certificates-relation-changed hook for easyrsa/0 2025-04-15 15:26:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:26:42 DEBUG unit.tf-analyticsdb/0.juju-log server.go:316 tls-certificates:59: Writing file /etc/contrail/ssl/analyticsdb/certs/ca-cert.pem root:root 644 2025-04-15 15:26:42 DEBUG unit.tf-analyticsdb/0.juju-log server.go:316 tls-certificates:59: Writing file /etc/contrail/ssl/analyticsdb/certs/server.pem root:root 644 2025-04-15 15:26:42 DEBUG unit.tf-analyticsdb/0.juju-log server.go:316 tls-certificates:59: Writing file /etc/contrail/ssl/analyticsdb/private/server-privkey.pem root:root 640 2025-04-15 15:26:42 INFO unit.tf-analyticsdb/0.juju-log server.go:316 tls-certificates:59: Certificates have been changed. Rewrite configs and rerun services. 2025-04-15 15:26:42 INFO unit.tf-analyticsdb/0.juju-log server.go:316 tls-certificates:59: analytics_ips is not in config. calculating... 2025-04-15 15:26:42 INFO unit.tf-analyticsdb/0.juju-log server.go:316 tls-certificates:59: CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': True, 'certs_hash': '570caa64f947e13573ac6e5a844c421217f5191effb55760ac9314756b246260bbe51d456209450cef1d316e524d92be', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'cloud_orchestrators': [], 'analyticsdb_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41']} 2025-04-15 15:26:42 INFO juju.worker.uniter.operation runhook.go:159 ran "tls-certificates-relation-changed" hook (via explicit, bespoke hook script) 2025-04-15 15:26:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (59; unit: easyrsa/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:43 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:26:43 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-changed (59; unit: easyrsa/0) hook) 2025-04-15 15:26:43 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:26:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:26:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:26:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (55; unit: tf-analytics/0) hook for tf-analyticsdb/0 2025-04-15 15:26:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-changed (55; unit: tf-analytics/0) hook) 2025-04-15 15:26:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-changed (55; unit: tf-analytics/0) hook) 2025-04-15 15:26:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (55; unit: tf-analytics/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (55; unit: tf-analytics/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-analyticsdb-relation-changed hook for tf-analytics/0 2025-04-15 15:26:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:26:46 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:55: ZIU: stage from relation None 2025-04-15 15:26:46 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:55: CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': True, 'certs_hash': '570caa64f947e13573ac6e5a844c421217f5191effb55760ac9314756b246260bbe51d456209450cef1d316e524d92be', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'cloud_orchestrators': [], 'analyticsdb_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41']} 2025-04-15 15:26:46 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-analyticsdb-relation-changed" hook (via explicit, bespoke hook script) 2025-04-15 15:26:46 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (55; unit: tf-analytics/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:26:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-changed (55; unit: tf-analytics/0) hook) 2025-04-15 15:26:46 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:26:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:26:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:26:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-analytics/0" already joined relation 55 2025-04-15 15:26:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 59 2025-04-15 15:26:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2025-04-15 15:26:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:26:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:26:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-analytics/0" already joined relation 55 2025-04-15 15:26:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 59 2025-04-15 15:26:54 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-analyticsdb/0 : {54 {map[tf-controller/0:{2}] map[] []}} 2025-04-15 15:26:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:26:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:26:54 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (54; unit: tf-controller/0) hook for tf-analyticsdb/0 2025-04-15 15:26:54 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-changed (54; unit: tf-controller/0) hook) 2025-04-15 15:26:58 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-changed (54; unit: tf-controller/0) hook) 2025-04-15 15:26:58 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:58 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:58 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-analyticsdb-relation-changed hook for tf-controller/0 2025-04-15 15:26:58 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:26:58 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: ZIU: stage from relation None 2025-04-15 15:26:58 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': True, 'certs_hash': '570caa64f947e13573ac6e5a844c421217f5191effb55760ac9314756b246260bbe51d456209450cef1d316e524d92be', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'cloud_orchestrators': [], 'analyticsdb_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41']} 2025-04-15 15:26:58 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-analyticsdb-relation-changed" hook (via explicit, bespoke hook script) 2025-04-15 15:26:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:26:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:26:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-changed (54; unit: tf-controller/0) hook) 2025-04-15 15:26:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:26:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:26:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:26:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-analytics/0" already joined relation 55 2025-04-15 15:26:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 59 2025-04-15 15:26:58 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2025-04-15 15:26:59 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-analyticsdb/0 : {54 {map[tf-controller/0:{3}] map[] []}} 2025-04-15 15:26:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:26:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:26:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (54; unit: tf-controller/0) hook for tf-analyticsdb/0 2025-04-15 15:26:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run relation-changed (54; unit: tf-controller/0) hook) 2025-04-15 15:27:06 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-analyticsdb/0 2025-04-15 15:27:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run relation-changed (54; unit: tf-controller/0) hook) 2025-04-15 15:27:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:27:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:27:20 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-analyticsdb-relation-changed hook for tf-controller/0 2025-04-15 15:27:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:27:20 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: ZIU: stage from relation None 2025-04-15 15:27:20 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': True, 'certs_hash': '570caa64f947e13573ac6e5a844c421217f5191effb55760ac9314756b246260bbe51d456209450cef1d316e524d92be', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'metadata_shared_secret': '1d643f26-30da-47bc-9428-3b5b885a66bd', 'compute_service_ip': '252.41.154.70', 'image_service_ip': '252.41.88.37', 'network_service_ip': '252.41.78.48', 'cloud_orchestrators': ['openstack'], 'cloud_orchestrator': 'openstack', 'analyticsdb_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41']} 2025-04-15 15:27:20 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: Render and store new configuration: /etc/contrail/common_analyticsdb.env 2025-04-15 15:27:20 DEBUG unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: Writing file /etc/contrail/common_analyticsdb.env root:root 600 2025-04-15 15:27:20 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: Configuration file has been created and is not logged. 2025-04-15 15:27:20 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: Render and store new configuration: /etc/contrail/analytics_database/docker-compose.yaml 2025-04-15 15:27:20 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: Making dir /etc/contrail/analytics_database root:root 755 2025-04-15 15:27:20 DEBUG unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: Writing file /etc/contrail/analytics_database/docker-compose.yaml root:root 600 2025-04-15 15:27:20 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: Configuration file has been created and is not logged. 2025-04-15 15:27:20 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating volume "analytics_database_analytics_cassandra" with default driver 2025-04-15 15:27:20 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_node-init_1 ... 2025-04-15 15:27:21 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_node-init_1 ... done 2025-04-15 15:27:21 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_query-engine_1 ... 2025-04-15 15:27:21 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_cassandra_1 ... 2025-04-15 15:27:21 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_nodemgr_1 ... 2025-04-15 15:27:21 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_provisioner_1 ... 2025-04-15 15:27:21 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_query-engine_1 ... done 2025-04-15 15:27:21 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_cassandra_1 ... done 2025-04-15 15:27:21 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_nodemgr_1 ... done 2025-04-15 15:27:21 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Creating analytics_database_provisioner_1 ... done 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Traceback (most recent call last): 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 809, in 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 main() 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 803, in main 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 contrail_pod_status(pod_name, pods[pod_name], options) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 541, in contrail_pod_status 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 status = contrail_service_status(container, pod_name, service, internal_svc_name, options) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 570, in contrail_service_status 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 return get_svc_uve_info(internal_svc_name, container, None, options) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 460, in get_svc_uve_info 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 get_svc_uve_status(svc_name, http_server_port, options) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 400, in get_svc_uve_status 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 node_status = svc_introspect.get_uve('NodeStatus') 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 370, in get_uve 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 return self.get_data(path, tname) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 374, in get_data 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 p = self._load(path) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 361, in _load 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 resp = self._make_request(path, not ssl_enabled) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/root/contrail-status.py", line 353, in _make_request 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 return requests.get(url, timeout=self._timeout) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/local/lib/python3.6/site-packages/requests/api.py", line 75, in get 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 return request('get', url, params=params, **kwargs) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/local/lib/python3.6/site-packages/requests/api.py", line 61, in request 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 return session.request(method=method, url=url, **kwargs) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/local/lib/python3.6/site-packages/requests/sessions.py", line 529, in request 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 resp = self.send(prep, **send_kwargs) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/local/lib/python3.6/site-packages/requests/sessions.py", line 645, in send 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 r = adapter.send(request, **kwargs) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/local/lib/python3.6/site-packages/requests/adapters.py", line 450, in send 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 timeout=timeout 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 823, in urlopen 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 self._put_conn(conn) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 316, in _put_conn 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 self.pool.put(conn, block=False) 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/lib64/python3.6/queue.py", line 145, in put 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 self.not_empty.notify() 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/lib64/python3.6/threading.py", line 344, in notify 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 if not self._is_owned(): 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/lib64/python3.6/threading.py", line 257, in _is_owned 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 if self._lock.acquire(0): 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/local/lib64/python3.6/site-packages/gevent/thread.py", line 141, in acquire 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 sleep() 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "/usr/local/lib64/python3.6/site-packages/gevent/hub.py", line 159, in sleep 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 waiter.get() 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "src/gevent/_waiter.py", line 143, in gevent._gevent_c_waiter.Waiter.get 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "src/gevent/_waiter.py", line 154, in gevent._gevent_c_waiter.Waiter.get 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "src/gevent/_greenlet_primitives.py", line 61, in gevent._gevent_c_greenlet_primitives.SwitchOutGreenletWithLoop.switch 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "src/gevent/_greenlet_primitives.py", line 61, in gevent._gevent_c_greenlet_primitives.SwitchOutGreenletWithLoop.switch 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "src/gevent/_greenlet_primitives.py", line 65, in gevent._gevent_c_greenlet_primitives.SwitchOutGreenletWithLoop.switch 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 File "src/gevent/_gevent_c_greenlet_primitives.pxd", line 35, in gevent._gevent_c_greenlet_primitives._greenlet_switch 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 gevent.exceptions.LoopExit: This operation would block forever 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Hub: >> threadpool=> thread_ident=0x7fd374563740> 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 Handles: 2025-04-15 15:27:28 WARNING unit.tf-analyticsdb/0.contrail-analyticsdb-relation-changed logger.go:60 [] 2025-04-15 15:27:29 INFO unit.tf-analyticsdb/0.juju-log server.go:316 contrail-analyticsdb:54: Container is not ready to get opensdn-status: Command 'export CONTRAIL_STATUS_CONTAINER_NAME=opensdn-status-analyticsdb ; opensdn-status --format json' returned non-zero exit status 1. 2025-04-15 15:27:29 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-analyticsdb-relation-changed" hook (via explicit, bespoke hook script) 2025-04-15 15:27:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (54; unit: tf-controller/0) hook" for tf-analyticsdb/0 2025-04-15 15:27:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:27:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run relation-changed (54; unit: tf-controller/0) hook) 2025-04-15 15:27:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:27:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:27:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:27:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-analytics/0" already joined relation 55 2025-04-15 15:27:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 59 2025-04-15 15:27:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-analyticsdb/0 2025-04-15 15:27:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-analyticsdb/0 uniter (run update-status hook) 2025-04-15 15:27:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-analyticsdb/0 uniter (run update-status hook) 2025-04-15 15:27:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-analyticsdb/0 2025-04-15 15:27:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-analyticsdb/0 2025-04-15 15:27:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-analyticsdb-0/agent.socket } 2025-04-15 15:27:40 INFO unit.tf-analyticsdb/0.juju-log server.go:316 ZIU: stage from config None 2025-04-15 15:27:40 INFO unit.tf-analyticsdb/0.juju-log server.go:316 CTX: {'module': 'analyticsdb', 'log_level': 'SYS_DEBUG', 'ssl_enabled': True, 'certs_hash': '570caa64f947e13573ac6e5a844c421217f5191effb55760ac9314756b246260bbe51d456209450cef1d316e524d92be', 'analyticsdb_minimum_diskgb': '4', 'jvm_extra_opts': '-Xms1g -Xmx2g', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_3_5-1', 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n', 'contrail_version': 9999, 'container_runtime': 'docker', 'metadata_shared_secret': '1d643f26-30da-47bc-9428-3b5b885a66bd', 'compute_service_ip': '252.41.154.70', 'image_service_ip': '252.41.88.37', 'network_service_ip': '252.41.78.48', 'cloud_orchestrators': ['openstack'], 'cloud_orchestrator': 'openstack', 'analyticsdb_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41']} 2025-04-15 15:27:40 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_analyticsdb.env 2025-04-15 15:27:40 DEBUG unit.tf-analyticsdb/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2025-04-15 15:27:40 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Configuration file has not been changed. 2025-04-15 15:27:40 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/analytics_database/docker-compose.yaml 2025-04-15 15:27:40 DEBUG unit.tf-analyticsdb/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2025-04-15 15:27:40 INFO unit.tf-analyticsdb/0.juju-log server.go:316 Configuration file has not been changed. 2025-04-15 15:27:40 WARNING unit.tf-analyticsdb/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-analyticsdb-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-15 15:27:40 WARNING unit.tf-analyticsdb/0.update-status logger.go:60 data = yaml.load(fh) 2025-04-15 15:27:41 DEBUG unit.tf-analyticsdb/0.juju-log server.go:316 Services actual count: 5, required count: 5 2025-04-15 15:27:48 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-15 15:27:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-analyticsdb/0 2025-04-15 15:27:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-15 15:27:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-analyticsdb/0 uniter (run update-status hook) 2025-04-15 15:27:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-analyticsdb/0 2025-04-15 15:27:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:27:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-analytics/0" already joined relation 55 2025-04-15 15:27:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 59 2025-04-15 15:27:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:27:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2025-04-15 15:27:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-15 15:27:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 54 2025-04-15 15:27:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-analytics/0" already joined relation 55 2025-04-15 15:27:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 59