2024-09-18 14:07:50 INFO juju unit_agent.go:289 Starting unit workers for "etcd/2" 2024-09-18 14:07:50 INFO juju.worker.apicaller connect.go:163 [a6afe8] "unit-etcd-2" successfully connected to "10.0.0.43:17070" 2024-09-18 14:07:50 INFO juju.worker.apicaller connect.go:260 [a6afe8] password changed for "unit-etcd-2" 2024-09-18 14:07:50 INFO juju.worker.apicaller connect.go:163 [a6afe8] "unit-etcd-2" successfully connected to "252.43.0.1:17070" 2024-09-18 14:07:50 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2024-09-18 14:07:50 INFO juju.worker.logger logger.go:120 logger worker started 2024-09-18 14:07:50 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-09-18 14:07:50.460707987 +0000 UTC 2024-09-18 14:07:50 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.43:17070 252.43.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2024-09-18 14:07:50 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-09-18 14:07:50 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-09-18 14:07:50.473366551 +0000 UTC 2024-09-18 14:07:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2024-09-18 14:07:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2024-09-18 14:07:50 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:07:50 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2024-09-18 14:07:50 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2024-09-18 14:07:50 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2024-09-18 14:07:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:07:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2024-09-18 14:07:50 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-etcd-2/run.socket } 2024-09-18 14:07:50 INFO juju.worker.uniter uniter.go:335 unit "etcd/2" started 2024-09-18 14:07:50 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-09-18 14:07:50 INFO juju.worker.uniter uniter.go:651 resuming charm install 2024-09-18 14:07:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation install cs:~containers/etcd-622 for etcd/2 2024-09-18 14:07:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install cs:~containers/etcd-622" for etcd/2 2024-09-18 14:07:50 INFO juju.worker.uniter.charm bundles.go:81 downloading cs:~containers/etcd-622 from API server 2024-09-18 14:07:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install cs:~containers/etcd-622" for etcd/2 2024-09-18 14:07:52 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "cs:~containers/etcd-622" 2024-09-18 14:07:52 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "cs:~containers/etcd-622" 2024-09-18 14:07:52 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "cs:~containers/etcd-622" 2024-09-18 14:07:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install cs:~containers/etcd-622" for etcd/2 2024-09-18 14:07:53 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/2: ok=true 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for etcd/2: ok=true, hashes=[3d2b77b64443168147f6713dab1931525b04213f4586c54a045733009b82788b] 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for etcd/2 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for etcd/2: ok=true, hashes=[17f2acda51310eebc7ec5fc33ba3e24c9838f484cf50956f7b6066f1d8bba28f] 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for etcd/2: ok=true, hashes=[51e9e2593d2d2d48099fb3c0fe9760058a9f2043cb2eddd9a7a27cc5b8850729] 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for etcd/2: [] ok=true 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for etcd/2: ok=true 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/2: ok=true 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for etcd/2 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-09-18 14:07:53 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for etcd/2: [] ok=true 2024-09-18 14:07:53 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2024-09-18 14:07:53 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2024-09-18 14:07:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/2 2024-09-18 14:07:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run install hook) 2024-09-18 14:07:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run install hook) 2024-09-18 14:07:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for etcd/2 2024-09-18 14:07:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for etcd/2 2024-09-18 14:07:54 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2024-09-18 14:07:54 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Reading package lists... 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Building dependency tree... 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Reading state information... 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 python3-setuptools is already the newest version (45.2.0-1ubuntu0.1). 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 python3-yaml is already the newest version (5.3.1-1ubuntu0.1). 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 python3-yaml set to manually installed. 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 The following additional packages will be installed: 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 cpp cpp-9 dpkg-dev fakeroot g++ g++-9 gcc gcc-9 gcc-9-base 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libasan5 libatomic1 libc-dev-bin libc6-dev libcc1-0 libcrypt-dev 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libdpkg-perl libexpat1-dev libfakeroot libfile-fcntllock-perl libgcc-9-dev 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libgomp1 libisl22 libitm1 liblsan0 libmpc3 libpython3-dev libpython3.8-dev 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libquadmath0 libstdc++-9-dev libtsan0 libubsan1 linux-libc-dev make 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 manpages-dev python-pip-whl python3.8-dev zlib1g-dev 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Suggested packages: 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 cpp-doc gcc-9-locales debian-keyring g++-multilib g++-9-multilib gcc-9-doc 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 gcc-multilib autoconf automake libtool flex bison gdb gcc-doc gcc-9-multilib 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 glibc-doc bzr libstdc++-9-doc make-doc 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 The following NEW packages will be installed: 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 build-essential cpp cpp-9 dpkg-dev fakeroot g++ g++-9 gcc gcc-9 gcc-9-base 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libasan5 libatomic1 libc-dev-bin libc6-dev libcc1-0 libcrypt-dev 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libdpkg-perl libexpat1-dev libfakeroot libfile-fcntllock-perl libgcc-9-dev 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libgomp1 libisl22 libitm1 liblsan0 libmpc3 libpython3-dev libpython3.8-dev 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 libquadmath0 libstdc++-9-dev libtsan0 libubsan1 linux-libc-dev make 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 manpages-dev python-pip-whl python3-dev python3-pip python3-wheel 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 python3.8-dev zlib1g-dev 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 0 upgraded, 44 newly installed, 0 to remove and 7 not upgraded. 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Need to get 49.9 MB of archives. 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 After this operation, 215 MB of additional disk space will be used. 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libc-dev-bin amd64 2.31-0ubuntu9.15 [71.8 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 linux-libc-dev amd64 5.4.0-181.201 [1134 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libcrypt-dev amd64 1:4.4.10-10ubuntu4 [104 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libc6-dev amd64 2.31-0ubuntu9.15 [2519 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 gcc-9-base amd64 9.4.0-1ubuntu1~20.04.3 [18.9 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libisl22 amd64 0.22.1-1 [592 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libmpc3 amd64 1.1.0-1 [40.8 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 cpp-9 amd64 9.4.0-1ubuntu1~20.04.3 [7500 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:9 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 cpp amd64 4:9.3.0-1ubuntu2 [27.6 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:10 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libcc1-0 amd64 10.5.0-1ubuntu1~20.04 [48.8 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:11 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libgomp1 amd64 10.5.0-1ubuntu1~20.04 [102 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:12 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libitm1 amd64 10.5.0-1ubuntu1~20.04 [26.2 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:13 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libatomic1 amd64 10.5.0-1ubuntu1~20.04 [9284 B] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:14 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 libasan5 amd64 9.4.0-1ubuntu1~20.04.3 [2753 kB] 2024-09-18 14:07:54 DEBUG unit.etcd/2.install logger.go:60 Get:15 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 liblsan0 amd64 10.5.0-1ubuntu1~20.04 [835 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:16 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libtsan0 amd64 10.5.0-1ubuntu1~20.04 [2016 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:17 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libubsan1 amd64 10.5.0-1ubuntu1~20.04 [785 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:18 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libquadmath0 amd64 10.5.0-1ubuntu1~20.04 [146 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:19 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 libgcc-9-dev amd64 9.4.0-1ubuntu1~20.04.3 [2361 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:20 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 gcc-9 amd64 9.4.0-1ubuntu1~20.04.3 [8275 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:21 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 gcc amd64 4:9.3.0-1ubuntu2 [5208 B] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:22 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 libstdc++-9-dev amd64 9.4.0-1ubuntu1~20.04.3 [1722 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:23 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 g++-9 amd64 9.4.0-1ubuntu1~20.04.3 [8421 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:24 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 g++ amd64 4:9.3.0-1ubuntu2 [1604 B] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:25 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 make amd64 4.2.1-1.2 [162 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:26 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libdpkg-perl all 1.19.7ubuntu3.2 [231 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:27 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 dpkg-dev all 1.19.7ubuntu3.2 [679 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:28 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates/main amd64 build-essential amd64 12.8ubuntu1.1 [4664 B] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:29 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libfakeroot amd64 1.24-1 [25.7 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:30 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 fakeroot amd64 1.24-1 [62.6 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:31 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libalgorithm-diff-perl all 1.19.03-2 [46.6 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:32 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libalgorithm-diff-xs-perl amd64 0.04-6 [11.3 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:33 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libalgorithm-merge-perl all 0.08-3 [12.0 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:34 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libexpat1-dev amd64 2.2.9-1ubuntu0.6 [116 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:35 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libfile-fcntllock-perl amd64 0.22-3build4 [33.1 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:36 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libpython3.8-dev amd64 3.8.10-0ubuntu1~20.04.9 [3950 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:37 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libpython3-dev amd64 3.8.2-0ubuntu2 [7236 B] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:38 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 manpages-dev all 5.05-1 [2266 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:39 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 python-pip-whl all 20.0.2-5ubuntu1.10 [1805 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:40 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-2ubuntu1.5 [155 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:41 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 python3.8-dev amd64 3.8.10-0ubuntu1~20.04.9 [514 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:42 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 python3-dev amd64 3.8.2-0ubuntu2 [1212 B] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:43 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 python3-wheel all 0.34.2-1ubuntu0.1 [23.9 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Get:44 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 python3-pip all 20.0.2-5ubuntu1.10 [231 kB] 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Fetched 49.9 MB in 0s (102 MB/s) 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libc-dev-bin. 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 64824 files and directories currently installed.) 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../00-libc-dev-bin_2.31-0ubuntu9.15_amd64.deb ... 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Unpacking libc-dev-bin (2.31-0ubuntu9.15) ... 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package linux-libc-dev:amd64. 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../01-linux-libc-dev_5.4.0-181.201_amd64.deb ... 2024-09-18 14:07:55 DEBUG unit.etcd/2.install logger.go:60 Unpacking linux-libc-dev:amd64 (5.4.0-181.201) ... 2024-09-18 14:07:56 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libcrypt-dev:amd64. 2024-09-18 14:07:56 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../02-libcrypt-dev_1%3a4.4.10-10ubuntu4_amd64.deb ... 2024-09-18 14:07:56 DEBUG unit.etcd/2.install logger.go:60 Unpacking libcrypt-dev:amd64 (1:4.4.10-10ubuntu4) ... 2024-09-18 14:07:56 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libc6-dev:amd64. 2024-09-18 14:07:56 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../03-libc6-dev_2.31-0ubuntu9.15_amd64.deb ... 2024-09-18 14:07:56 DEBUG unit.etcd/2.install logger.go:60 Unpacking libc6-dev:amd64 (2.31-0ubuntu9.15) ... 2024-09-18 14:07:57 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package gcc-9-base:amd64. 2024-09-18 14:07:57 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../04-gcc-9-base_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-18 14:07:57 DEBUG unit.etcd/2.install logger.go:60 Unpacking gcc-9-base:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:07:57 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libisl22:amd64. 2024-09-18 14:07:57 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../05-libisl22_0.22.1-1_amd64.deb ... 2024-09-18 14:07:57 DEBUG unit.etcd/2.install logger.go:60 Unpacking libisl22:amd64 (0.22.1-1) ... 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libmpc3:amd64. 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../06-libmpc3_1.1.0-1_amd64.deb ... 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Unpacking libmpc3:amd64 (1.1.0-1) ... 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package cpp-9. 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../07-cpp-9_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Unpacking cpp-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package cpp. 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../08-cpp_4%3a9.3.0-1ubuntu2_amd64.deb ... 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Unpacking cpp (4:9.3.0-1ubuntu2) ... 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libcc1-0:amd64. 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../09-libcc1-0_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-18 14:07:58 DEBUG unit.etcd/2.install logger.go:60 Unpacking libcc1-0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libgomp1:amd64. 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../10-libgomp1_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Unpacking libgomp1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libitm1:amd64. 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../11-libitm1_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Unpacking libitm1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libatomic1:amd64. 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../12-libatomic1_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Unpacking libatomic1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libasan5:amd64. 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../13-libasan5_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Unpacking libasan5:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package liblsan0:amd64. 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../14-liblsan0_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Unpacking liblsan0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libtsan0:amd64. 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../15-libtsan0_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Unpacking libtsan0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libubsan1:amd64. 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../16-libubsan1_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-18 14:07:59 DEBUG unit.etcd/2.install logger.go:60 Unpacking libubsan1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:00 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libquadmath0:amd64. 2024-09-18 14:08:00 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../17-libquadmath0_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-18 14:08:00 DEBUG unit.etcd/2.install logger.go:60 Unpacking libquadmath0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:00 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libgcc-9-dev:amd64. 2024-09-18 14:08:00 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../18-libgcc-9-dev_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-18 14:08:00 DEBUG unit.etcd/2.install logger.go:60 Unpacking libgcc-9-dev:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:00 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package gcc-9. 2024-09-18 14:08:00 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../19-gcc-9_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-18 14:08:00 DEBUG unit.etcd/2.install logger.go:60 Unpacking gcc-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:01 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package gcc. 2024-09-18 14:08:01 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../20-gcc_4%3a9.3.0-1ubuntu2_amd64.deb ... 2024-09-18 14:08:01 DEBUG unit.etcd/2.install logger.go:60 Unpacking gcc (4:9.3.0-1ubuntu2) ... 2024-09-18 14:08:01 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libstdc++-9-dev:amd64. 2024-09-18 14:08:01 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../21-libstdc++-9-dev_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-18 14:08:01 DEBUG unit.etcd/2.install logger.go:60 Unpacking libstdc++-9-dev:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:01 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package g++-9. 2024-09-18 14:08:01 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../22-g++-9_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-18 14:08:01 DEBUG unit.etcd/2.install logger.go:60 Unpacking g++-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package g++. 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../23-g++_4%3a9.3.0-1ubuntu2_amd64.deb ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Unpacking g++ (4:9.3.0-1ubuntu2) ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package make. 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../24-make_4.2.1-1.2_amd64.deb ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Unpacking make (4.2.1-1.2) ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libdpkg-perl. 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../25-libdpkg-perl_1.19.7ubuntu3.2_all.deb ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Unpacking libdpkg-perl (1.19.7ubuntu3.2) ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package dpkg-dev. 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../26-dpkg-dev_1.19.7ubuntu3.2_all.deb ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Unpacking dpkg-dev (1.19.7ubuntu3.2) ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package build-essential. 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../27-build-essential_12.8ubuntu1.1_amd64.deb ... 2024-09-18 14:08:02 DEBUG unit.etcd/2.install logger.go:60 Unpacking build-essential (12.8ubuntu1.1) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libfakeroot:amd64. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../28-libfakeroot_1.24-1_amd64.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking libfakeroot:amd64 (1.24-1) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package fakeroot. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../29-fakeroot_1.24-1_amd64.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking fakeroot (1.24-1) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libalgorithm-diff-perl. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../30-libalgorithm-diff-perl_1.19.03-2_all.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking libalgorithm-diff-perl (1.19.03-2) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libalgorithm-diff-xs-perl. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../31-libalgorithm-diff-xs-perl_0.04-6_amd64.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking libalgorithm-diff-xs-perl (0.04-6) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libalgorithm-merge-perl. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../32-libalgorithm-merge-perl_0.08-3_all.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking libalgorithm-merge-perl (0.08-3) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libexpat1-dev:amd64. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../33-libexpat1-dev_2.2.9-1ubuntu0.6_amd64.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking libexpat1-dev:amd64 (2.2.9-1ubuntu0.6) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libfile-fcntllock-perl. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../34-libfile-fcntllock-perl_0.22-3build4_amd64.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking libfile-fcntllock-perl (0.22-3build4) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libpython3.8-dev:amd64. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../35-libpython3.8-dev_3.8.10-0ubuntu1~20.04.9_amd64.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04.9) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package libpython3-dev:amd64. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../36-libpython3-dev_3.8.2-0ubuntu2_amd64.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking libpython3-dev:amd64 (3.8.2-0ubuntu2) ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package manpages-dev. 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../37-manpages-dev_5.05-1_all.deb ... 2024-09-18 14:08:03 DEBUG unit.etcd/2.install logger.go:60 Unpacking manpages-dev (5.05-1) ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package python-pip-whl. 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../38-python-pip-whl_20.0.2-5ubuntu1.10_all.deb ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Unpacking python-pip-whl (20.0.2-5ubuntu1.10) ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package zlib1g-dev:amd64. 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../39-zlib1g-dev_1%3a1.2.11.dfsg-2ubuntu1.5_amd64.deb ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu1.5) ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package python3.8-dev. 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../40-python3.8-dev_3.8.10-0ubuntu1~20.04.9_amd64.deb ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Unpacking python3.8-dev (3.8.10-0ubuntu1~20.04.9) ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package python3-dev. 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../41-python3-dev_3.8.2-0ubuntu2_amd64.deb ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Unpacking python3-dev (3.8.2-0ubuntu2) ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package python3-wheel. 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../42-python3-wheel_0.34.2-1ubuntu0.1_all.deb ... 2024-09-18 14:08:04 DEBUG unit.etcd/2.install logger.go:60 Unpacking python3-wheel (0.34.2-1ubuntu0.1) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package python3-pip. 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../43-python3-pip_20.0.2-5ubuntu1.10_all.deb ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Unpacking python3-pip (20.0.2-5ubuntu1.10) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up manpages-dev (5.05-1) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libfile-fcntllock-perl (0.22-3build4) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libalgorithm-diff-perl (1.19.03-2) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up linux-libc-dev:amd64 (5.4.0-181.201) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libgomp1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up python3-wheel (0.34.2-1ubuntu0.1) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libfakeroot:amd64 (1.24-1) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up fakeroot (1.24-1) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 update-alternatives: using /usr/bin/fakeroot-sysv to provide /usr/bin/fakeroot (fakeroot) in auto mode 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up make (4.2.1-1.2) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libquadmath0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libmpc3:amd64 (1.1.0-1) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libatomic1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libdpkg-perl (1.19.7ubuntu3.2) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libubsan1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libcrypt-dev:amd64 (1:4.4.10-10ubuntu4) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libisl22:amd64 (0.22.1-1) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up python-pip-whl (20.0.2-5ubuntu1.10) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libc-dev-bin (2.31-0ubuntu9.15) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libalgorithm-diff-xs-perl (0.04-6) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libcc1-0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up liblsan0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libitm1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up gcc-9-base:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libalgorithm-merge-perl (0.08-3) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libtsan0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up dpkg-dev (1.19.7ubuntu3.2) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libasan5:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up python3-pip (20.0.2-5ubuntu1.10) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up cpp-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libc6-dev:amd64 (2.31-0ubuntu9.15) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libgcc-9-dev:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libexpat1-dev:amd64 (2.2.9-1ubuntu0.6) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04.9) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu1.5) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up cpp (4:9.3.0-1ubuntu2) ... 2024-09-18 14:08:05 DEBUG unit.etcd/2.install logger.go:60 Setting up gcc-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 Setting up libpython3-dev:amd64 (3.8.2-0ubuntu2) ... 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 Setting up libstdc++-9-dev:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 Setting up gcc (4:9.3.0-1ubuntu2) ... 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 Setting up g++-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 Setting up python3.8-dev (3.8.10-0ubuntu1~20.04.9) ... 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 Setting up g++ (4:9.3.0-1ubuntu2) ... 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 Setting up build-essential (12.8ubuntu1.1) ... 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 Setting up python3-dev (3.8.2-0ubuntu2) ... 2024-09-18 14:08:06 DEBUG unit.etcd/2.install logger.go:60 Processing triggers for man-db (2.9.1-1) ... 2024-09-18 14:08:15 DEBUG unit.etcd/2.install logger.go:60 Processing triggers for libc-bin (2.31-0ubuntu9.15) ... 2024-09-18 14:08:16 DEBUG unit.etcd/2.install logger.go:60 Reading package lists... 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Building dependency tree... 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Reading state information... 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 rsync is already the newest version (3.1.3-8ubuntu0.7). 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 rsync set to manually installed. 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Reading package lists... 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Building dependency tree... 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Reading state information... 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 The following additional packages will be installed: 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 python3-appdirs python3-distlib python3-filelock python3-virtualenv 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 The following NEW packages will be installed: 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 python3-appdirs python3-distlib python3-filelock python3-virtualenv 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 virtualenv 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 0 upgraded, 5 newly installed, 0 to remove and 7 not upgraded. 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Need to get 199 kB of archives. 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 After this operation, 1056 kB of additional disk space will be used. 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 python3-appdirs all 1.4.3-2.1 [10.8 kB] 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/universe amd64 python3-distlib all 0.3.0-1 [116 kB] 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/universe amd64 python3-filelock all 3.0.12-2 [7948 B] 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 python3-virtualenv all 20.0.17-1ubuntu0.4 [62.7 kB] 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 virtualenv all 20.0.17-1ubuntu0.4 [2144 B] 2024-09-18 14:08:17 DEBUG unit.etcd/2.install logger.go:60 Fetched 199 kB in 0s (14.7 MB/s) 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package python3-appdirs. 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 70670 files and directories currently installed.) 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../python3-appdirs_1.4.3-2.1_all.deb ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Unpacking python3-appdirs (1.4.3-2.1) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package python3-distlib. 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../python3-distlib_0.3.0-1_all.deb ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Unpacking python3-distlib (0.3.0-1) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package python3-filelock. 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../python3-filelock_3.0.12-2_all.deb ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Unpacking python3-filelock (3.0.12-2) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package python3-virtualenv. 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../python3-virtualenv_20.0.17-1ubuntu0.4_all.deb ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Unpacking python3-virtualenv (20.0.17-1ubuntu0.4) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Selecting previously unselected package virtualenv. 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Preparing to unpack .../virtualenv_20.0.17-1ubuntu0.4_all.deb ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Unpacking virtualenv (20.0.17-1ubuntu0.4) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Setting up python3-filelock (3.0.12-2) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Setting up python3-distlib (0.3.0-1) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Setting up python3-appdirs (1.4.3-2.1) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Setting up python3-virtualenv (20.0.17-1ubuntu0.4) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Setting up virtualenv (20.0.17-1ubuntu0.4) ... 2024-09-18 14:08:18 DEBUG unit.etcd/2.install logger.go:60 Processing triggers for man-db (2.9.1-1) ... 2024-09-18 14:08:20 DEBUG unit.etcd/2.install logger.go:60 created virtual environment CPython3.8.10.final.0-64 in 182ms 2024-09-18 14:08:20 DEBUG unit.etcd/2.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-etcd-2/.venv, clear=False, global=False) 2024-09-18 14:08:20 DEBUG unit.etcd/2.install logger.go:60 seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, pkg_resources=latest, via=copy, app_data_dir=/root/.local/share/virtualenv/seed-app-data/v1.0.1.debian.1) 2024-09-18 14:08:20 DEBUG unit.etcd/2.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator 2024-09-18 14:08:22 DEBUG unit.etcd/2.install logger.go:60 Looking in links: wheelhouse 2024-09-18 14:08:22 DEBUG unit.etcd/2.install logger.go:60 Requirement already up-to-date: pip in /var/lib/juju/agents/unit-etcd-2/.venv/lib/python3.8/site-packages (20.0.2) 2024-09-18 14:08:23 DEBUG unit.etcd/2.install logger.go:60 Looking in links: wheelhouse 2024-09-18 14:08:23 DEBUG unit.etcd/2.install logger.go:60 Requirement already up-to-date: setuptools in /var/lib/juju/agents/unit-etcd-2/.venv/lib/python3.8/site-packages (44.0.0) 2024-09-18 14:08:24 DEBUG unit.etcd/2.install logger.go:60 Looking in links: wheelhouse 2024-09-18 14:08:24 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/setuptools_scm-1.17.0.tar.gz 2024-09-18 14:08:24 DEBUG unit.etcd/2.install logger.go:60 Building wheels for collected packages: setuptools-scm 2024-09-18 14:08:24 DEBUG unit.etcd/2.install logger.go:60 Building wheel for setuptools-scm (setup.py): started 2024-09-18 14:08:25 DEBUG unit.etcd/2.install logger.go:60 Building wheel for setuptools-scm (setup.py): finished with status 'done' 2024-09-18 14:08:25 DEBUG unit.etcd/2.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-1.17.0-py2.py3-none-any.whl size=17696 sha256=f6b096c1c4f9642ec1bad9930d186dafb69949f86d9f010ed20194ce9871cd3b 2024-09-18 14:08:25 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/36/e1/7e/2156d1b757c803aff05163b070b6062fbac34bd86285c13dc3 2024-09-18 14:08:25 DEBUG unit.etcd/2.install logger.go:60 Successfully built setuptools-scm 2024-09-18 14:08:25 DEBUG unit.etcd/2.install logger.go:60 Installing collected packages: setuptools-scm 2024-09-18 14:08:25 DEBUG unit.etcd/2.install logger.go:60 Successfully installed setuptools-scm-1.17.0 2024-09-18 14:08:26 DEBUG unit.etcd/2.install logger.go:60 Looking in links: wheelhouse 2024-09-18 14:08:26 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/charms.templating.jinja2-1.0.2.tar.gz 2024-09-18 14:08:26 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/Tempita-0.5.2.tar.gz 2024-09-18 14:08:26 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/six-1.16.0.tar.gz 2024-09-18 14:08:26 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/wheel-0.33.6.tar.gz 2024-09-18 14:08:26 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.4.1.tar.gz 2024-09-18 14:08:27 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/pyaml-21.8.3.tar.gz 2024-09-18 14:08:27 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/PyYAML-5.2.tar.gz 2024-09-18 14:08:27 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2024-09-18 14:08:27 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/charmhelpers-0.20.22.tar.gz 2024-09-18 14:08:29 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/Jinja2-2.10.1.tar.gz 2024-09-18 14:08:29 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/tenacity-5.0.3.tar.gz 2024-09-18 14:08:30 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/MarkupSafe-1.1.1.tar.gz 2024-09-18 14:08:31 DEBUG unit.etcd/2.install logger.go:60 Processing ./wheelhouse/pbr-5.6.0.tar.gz 2024-09-18 14:08:31 DEBUG unit.etcd/2.install logger.go:60 Building wheels for collected packages: charms.templating.jinja2, Tempita, six, wheel, charms.reactive, pyaml, PyYAML, netaddr, charmhelpers, Jinja2, tenacity, MarkupSafe, pbr 2024-09-18 14:08:31 DEBUG unit.etcd/2.install logger.go:60 Building wheel for charms.templating.jinja2 (setup.py): started 2024-09-18 14:08:31 DEBUG unit.etcd/2.install logger.go:60 Building wheel for charms.templating.jinja2 (setup.py): finished with status 'done' 2024-09-18 14:08:31 DEBUG unit.etcd/2.install logger.go:60 Created wheel for charms.templating.jinja2: filename=charms.templating.jinja2-1.0.2-py3-none-any.whl size=4020 sha256=aa7a1350a659ac99dc1b49cf808c7d0cb98fe3fe038d28e247a1521f40f86965 2024-09-18 14:08:31 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/35/e5/4d/f25af634dbb183ba7ba7101beb76d90c60b627a2ef741a6c80 2024-09-18 14:08:31 DEBUG unit.etcd/2.install logger.go:60 Building wheel for Tempita (setup.py): started 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Building wheel for Tempita (setup.py): finished with status 'done' 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Created wheel for Tempita: filename=Tempita-0.5.2-py3-none-any.whl size=12880 sha256=b2d7b7feed7ed6bcdc0fbaf62496f644fa15d1f754c522b627af1f7e0ce9d89f 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/09/67/e7/2344d1a5fcc042dd4d3244c8054e37764e7f54fb2d213bfe9f 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Building wheel for six (setup.py): started 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Building wheel for six (setup.py): finished with status 'done' 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Created wheel for six: filename=six-1.16.0-py2.py3-none-any.whl size=11053 sha256=d1f15969daff7c3924cbc852ee7ef3799ee463366f29ec903bcc9feda1370385 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/74/82/82/b452441abde02a33aa70dad60af08a5122b23bf84ba0363d7a 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Building wheel for wheel (setup.py): started 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Created wheel for wheel: filename=wheel-0.33.6-py2.py3-none-any.whl size=21555 sha256=cbefeb4568cb3f8427757da1631bdb786903ac865a787f8cd93da2a777cb7899 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/41/49/89/e3ce6d1e07899feaaad220706369fece658d477ae232a8f285 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.4.1-py3-none-any.whl size=43697 sha256=3c0a28e6f097ca8a98fd4108c18591e8a058f2393ebf75f0d30f0a25d36f24e3 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/08/75/04/88b7e657680556ad5b720c31dc860e2bd92fae79e1d8e79f29 2024-09-18 14:08:32 DEBUG unit.etcd/2.install logger.go:60 Building wheel for pyaml (setup.py): started 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Created wheel for pyaml: filename=pyaml-21.8.3-py2.py3-none-any.whl size=17425 sha256=77c8b1bd8e06a6b959904908e097fcc965c4e8ee3b80523ff0903e95e496737a 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/90/94/37/3d4e248839f6fb949247e4e2b6b3af95ec017a7144cb1c1925 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Building wheel for PyYAML (setup.py): started 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Building wheel for PyYAML (setup.py): finished with status 'done' 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-5.2-cp38-cp38-linux_x86_64.whl size=44208 sha256=98dedb21aabc567588d28f4f44c7dc9dfd0349be1a16d8cf6e369a193a9d76ef 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/23/ad/1d/b885f127d4fb85a08a1c064a3c52cf01766f4e24e471a0516c 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Building wheel for netaddr (setup.py): started 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627892 sha256=ea0a83a34d49b8641fbfd08672488d0e764c9e6cdce57692d72891ee17385a88 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/55/ae/57/f92196dd764ee83d9931e2efa017153a724770efba01fdb056 2024-09-18 14:08:33 DEBUG unit.etcd/2.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-0.20.22-py3-none-any.whl size=432838 sha256=d13e13a206c9ee8964b1e022fd2ddac7a1121ec9dcc564f6c1ae9b464aa8d0f7 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/0c/db/5e/45c53da6746b642265657700bd89babd5ce0d2828593eafc45 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-2.10.1-py2.py3-none-any.whl size=124884 sha256=83636324db292cc59321623900022d631ad9c7e6051232304343842cf97b63d0 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/bf/4f/9f/685be4bfadd31ad24e9c7b6b1b07918f9f7f975a4c7b4778db 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Building wheel for tenacity (setup.py): started 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Building wheel for tenacity (setup.py): finished with status 'done' 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Created wheel for tenacity: filename=tenacity-5.0.3-py2.py3-none-any.whl size=38871 sha256=4f731f3334185628d4df7c37a8f531b759224f5a4123811bdd671c9850e81326 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/42/79/64/0a9b2abce4fd3dad52a1f145755d3b01cb52da96405804f157 2024-09-18 14:08:34 DEBUG unit.etcd/2.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-1.1.1-cp38-cp38-linux_x86_64.whl size=32951 sha256=22c38cf67357e7a0b5ef41b1633e6584bdf769c1f02c6bcd45dab0a23e132a0c 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/6c/86/7e/2ab969fc27b62745bb4f0637442d7b3a9050456bf45e3d58ed 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Building wheel for pbr (setup.py): started 2024-09-18 14:08:35 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {10 {map[easyrsa/0:{0}] map[] []}} 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Created wheel for pbr: filename=pbr-5.6.0-py2.py3-none-any.whl size=111309 sha256=e5fae73c3e4d32b54518c27f7b2af4a8441e35eb01a3b76fc98d8dc353339300 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-li2rwm16/wheels/84/4c/bf/7fd008677b4323412e4b9532192d78e1907249192a65f3c9aa 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Successfully built charms.templating.jinja2 Tempita six wheel charms.reactive pyaml PyYAML netaddr charmhelpers Jinja2 tenacity MarkupSafe pbr 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Installing collected packages: MarkupSafe, Jinja2, PyYAML, Tempita, netaddr, pbr, six, charmhelpers, charms.templating.jinja2, wheel, pyaml, charms.reactive, tenacity 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Attempting uninstall: wheel 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Found existing installation: wheel 0.34.2 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Uninstalling wheel-0.34.2: 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Successfully uninstalled wheel-0.34.2 2024-09-18 14:08:35 DEBUG unit.etcd/2.install logger.go:60 Successfully installed Jinja2-2.10.1 MarkupSafe-1.1.1 PyYAML-5.2 Tempita-0.5.2 charmhelpers-0.20.22 charms.reactive-1.4.1 charms.templating.jinja2-1.0.2 netaddr-0.7.19 pbr-5.6.0 pyaml-21.8.3 six-1.16.0 tenacity-5.0.3 wheel-0.33.6 2024-09-18 14:08:36 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook install 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.changed 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.nagios_context 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.changed.port 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.changed.management_port 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.changed.channel 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.changed.bind_to_all_interfaces 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:08:36 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:08:36 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:08:36 DEBUG unit.etcd/2.install logger.go:60 none 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 21 flags set tracer: set flag config.changed tracer: set flag config.changed.bind_to_all_interfaces tracer: set flag config.changed.channel tracer: set flag config.changed.management_port tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.port tracer: set flag config.changed.snapd_refresh tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:332:channel_changed tracer: ++ queue handler reactive/etcd.py:338:snap_install tracer: ++ queue handler reactive/etcd.py:748:force_update_nrpe_config 2024-09-18 14:08:36 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 Writing file /usr/bin/cdk-service-kicker root:root 444 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 Writing file /etc/systemd/system/cdk-service-kicker.service root:root 444 2024-09-18 14:08:36 WARNING unit.etcd/2.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/cdk-service-kicker.service → /etc/systemd/system/cdk-service-kicker.service. 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag cdk-service-kicker.installed tracer: -- dequeue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2024-09-18 14:08:36 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:08:36 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:332:channel_changed 2024-09-18 14:08:36 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag etcd.rerender-config tracer: ++ queue handler reactive/etcd.py:235:rerender_config 2024-09-18 14:08:36 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:338:snap_install 2024-09-18 14:08:38 INFO unit.etcd/2.juju-log server.go:316 Installing core from store 2024-09-18 14:08:47 DEBUG unit.etcd/2.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=stable', 'core']" output="b'core 16-2.61.4-20240607 from Canonical** installed\n'" 2024-09-18 14:08:47 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag snap.installed.core tracer: ++ queue handler reactive/snap.py:329:change_snapd_refresh 2024-09-18 14:08:48 INFO unit.etcd/2.juju-log server.go:316 Installing etcd from store 2024-09-18 14:08:58 DEBUG unit.etcd/2.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=3.4/stable', 'etcd']" output="b'etcd (3.4/stable) 3.4.22 from Canonical** installed\n'" 2024-09-18 14:08:58 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag snap.installed.etcd tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:218:follower_config_changed tracer: ++ queue handler reactive/etcd.py:228:bind_to_all_interfaces_changed tracer: ++ queue handler reactive/etcd.py:367:add_systemd_restart_always tracer: ++ queue handler reactive/etcd.py:570:render_default_user_ssl_exports 2024-09-18 14:08:58 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:748:force_update_nrpe_config 2024-09-18 14:08:58 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-18 14:08:58 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:08:58 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:218:follower_config_changed 2024-09-18 14:08:58 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:228:bind_to_all_interfaces_changed 2024-09-18 14:08:58 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:235:rerender_config 2024-09-18 14:08:58 INFO unit.etcd/2.juju-log server.go:316 Rendering config file for etcd2 2024-09-18 14:08:59 DEBUG unit.etcd/2.juju-log server.go:316 Writing file /var/snap/etcd/common/etcd.conf.yml root:root 444 2024-09-18 14:08:59 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: cleared flag etcd.rerender-config tracer: -- dequeue handler reactive/etcd.py:235:rerender_config 2024-09-18 14:08:59 DEBUG unit.etcd/2.install logger.go:60 inactive 2024-09-18 14:08:59 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:367:add_systemd_restart_always 2024-09-18 14:08:59 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag etcd.service-restart.configured tracer: -- dequeue handler reactive/etcd.py:367:add_systemd_restart_always 2024-09-18 14:08:59 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:570:render_default_user_ssl_exports 2024-09-18 14:08:59 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag etcd.ssl.exported tracer: -- dequeue handler reactive/etcd.py:570:render_default_user_ssl_exports 2024-09-18 14:08:59 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/snap.py:329:change_snapd_refresh 2024-09-18 14:08:59 INFO unit.etcd/2.juju-log server.go:316 Set config refresh.timer=tue3 for snap core 2024-09-18 14:09:02 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag snap.refresh.was-set 2024-09-18 14:09:02 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag snap.refresh.set tracer: -- dequeue handler reactive/snap.py:329:change_snapd_refresh 2024-09-18 14:09:02 INFO unit.etcd/2.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-18 14:09:03 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2024-09-18 14:09:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for etcd/2 2024-09-18 14:09:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:09:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run install hook) 2024-09-18 14:09:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:09:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/2" (leader=false) entered scope for relation "etcd:cluster" 2024-09-18 14:09:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/2" (leader=false) entered scope for relation "kubernetes-master:etcd etcd:db" 2024-09-18 14:09:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/2" (leader=false) entered scope for relation "etcd:certificates easyrsa:client" 2024-09-18 14:09:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (0; app: etcd) hook for etcd/2 2024-09-18 14:09:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-created (0; app: etcd) hook) 2024-09-18 14:09:04 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {0 {map[etcd/1:{0}] map[] []}} 2024-09-18 14:09:05 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/2: ok=true 2024-09-18 14:09:10 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/2: ok=true 2024-09-18 14:09:10 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {0 {map[etcd/0:{0}] map[] []}} 2024-09-18 14:10:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-created (0; app: etcd) hook) 2024-09-18 14:10:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (0; app: etcd) hook" for etcd/2 2024-09-18 14:10:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (0; app: etcd) hook" for etcd/2 2024-09-18 14:10:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-created hook 2024-09-18 14:10:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:10:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-created 2024-09-18 14:10:48 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {8 {map[kubernetes-master/2:{0}] map[] []}} 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:10:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is follower) 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: set flag leadership.changed.snapd_refresh tracer: ++ queue handler reactive/etcd.py:515:set_snapd_timer 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag leadership.set.snapd_refresh 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag leadership.changed.token 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag leadership.set.token 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag leadership.changed 2024-09-18 14:10:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-18 14:10:48 DEBUG unit.etcd/2.cluster-relation-created logger.go:60 none 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.changed tracer: set flag leadership.changed.snapd_refresh tracer: set flag leadership.changed.token tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-18 14:10:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:515:set_snapd_timer 2024-09-18 14:10:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:10:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:10:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:515:set_snapd_timer 2024-09-18 14:10:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: setting snapd_refresh timer to: tue3 2024-09-18 14:10:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Set config refresh.timer=tue3 for snap core 2024-09-18 14:10:52 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-18 14:10:52 INFO unit.etcd/2.juju-log server.go:316 cluster:0: status-set: blocked: Missing relation to certificate authority. 2024-09-18 14:10:52 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-created" hook (via explicit, bespoke hook script) 2024-09-18 14:10:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (0; app: etcd) hook" for etcd/2 2024-09-18 14:10:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:10:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-created (0; app: etcd) hook) 2024-09-18 14:10:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:10:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (8; app: kubernetes-master) hook for etcd/2 2024-09-18 14:10:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-created (8; app: kubernetes-master) hook) 2024-09-18 14:10:59 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {8 {map[kubernetes-master/1:{0}] map[] []}} 2024-09-18 14:11:08 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {8 {map[kubernetes-master/0:{0}] map[] []}} 2024-09-18 14:11:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-created (8; app: kubernetes-master) hook) 2024-09-18 14:11:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (8; app: kubernetes-master) hook" for etcd/2 2024-09-18 14:11:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (8; app: kubernetes-master) hook" for etcd/2 2024-09-18 14:11:56 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-created hook 2024-09-18 14:11:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:11:57 INFO unit.etcd/2.juju-log server.go:316 db:8: Reactive main running for hook db-relation-created 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:515:set_snapd_timer 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:11:57 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Leadership Layer (is follower) 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: cleared flag leadership.changed.snapd_refresh tracer: -- dequeue handler reactive/etcd.py:515:set_snapd_timer 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: cleared flag leadership.changed.token 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: cleared flag leadership.changed 2024-09-18 14:11:57 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-18 14:11:57 DEBUG unit.etcd/2.db-relation-created logger.go:60 none 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: hooks phase, 0 handlers queued 2024-09-18 14:11:57 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:11:57 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:11:57 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:11:57 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-18 14:11:57 INFO unit.etcd/2.juju-log server.go:316 db:8: status-set: blocked: Missing relation to certificate authority. 2024-09-18 14:11:57 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-created" hook (via explicit, bespoke hook script) 2024-09-18 14:11:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (8; app: kubernetes-master) hook" for etcd/2 2024-09-18 14:11:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:11:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-created (8; app: kubernetes-master) hook) 2024-09-18 14:11:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:11:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (10; app: easyrsa) hook for etcd/2 2024-09-18 14:11:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-created (10; app: easyrsa) hook) 2024-09-18 14:12:03 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-created (10; app: easyrsa) hook) 2024-09-18 14:12:03 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (10; app: easyrsa) hook" for etcd/2 2024-09-18 14:12:03 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (10; app: easyrsa) hook" for etcd/2 2024-09-18 14:12:03 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-created hook 2024-09-18 14:12:03 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:03 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-created 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:12:03 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is follower) 2024-09-18 14:12:03 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-18 14:12:03 DEBUG unit.etcd/2.certificates-relation-created logger.go:60 none 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-18 14:12:03 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:03 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:12:03 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:03 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-18 14:12:03 INFO unit.etcd/2.juju-log server.go:316 certificates:10: status-set: blocked: Missing relation to certificate authority. 2024-09-18 14:12:04 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-created" hook (via explicit, bespoke hook script) 2024-09-18 14:12:04 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (10; app: easyrsa) hook" for etcd/2 2024-09-18 14:12:04 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:12:04 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-created (10; app: easyrsa) hook) 2024-09-18 14:12:04 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:12:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for etcd/2 2024-09-18 14:12:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run leader-settings-changed hook) 2024-09-18 14:12:09 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run leader-settings-changed hook) 2024-09-18 14:12:09 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for etcd/2 2024-09-18 14:12:09 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for etcd/2 2024-09-18 14:12:09 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-09-18 14:12:09 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:09 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:12:09 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:12:09 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:12:09 DEBUG unit.etcd/2.leader-settings-changed logger.go:60 none 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:12:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:09 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:12:09 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:09 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-18 14:12:09 INFO unit.etcd/2.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-18 14:12:10 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:12:10 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for etcd/2 2024-09-18 14:12:10 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:12:10 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run leader-settings-changed hook) 2024-09-18 14:12:10 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:12:10 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:12:10 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for etcd/2 2024-09-18 14:12:10 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run config-changed hook) 2024-09-18 14:12:15 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run config-changed hook) 2024-09-18 14:12:15 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for etcd/2 2024-09-18 14:12:15 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for etcd/2 2024-09-18 14:12:15 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2024-09-18 14:12:15 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:15 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook config-changed 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:12:15 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:12:15 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:12:15 DEBUG unit.etcd/2.config-changed logger.go:60 none 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:12:15 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:15 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:12:16 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:16 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-18 14:12:16 INFO unit.etcd/2.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-18 14:12:16 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:12:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for etcd/2 2024-09-18 14:12:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:12:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run config-changed hook) 2024-09-18 14:12:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:12:16 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2024-09-18 14:12:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for etcd/2 2024-09-18 14:12:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run start hook) 2024-09-18 14:12:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run start hook) 2024-09-18 14:12:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for etcd/2 2024-09-18 14:12:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for etcd/2 2024-09-18 14:12:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2024-09-18 14:12:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:21 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook start 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:12:21 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:12:21 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:12:21 DEBUG unit.etcd/2.start logger.go:60 none 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:12:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:21 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:12:22 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:22 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-18 14:12:22 INFO unit.etcd/2.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-18 14:12:22 INFO juju.worker.uniter.operation runhook.go:159 ran "start" hook (via explicit, bespoke hook script) 2024-09-18 14:12:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for etcd/2 2024-09-18 14:12:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:12:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run start hook) 2024-09-18 14:12:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:12:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:12:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (10; unit: easyrsa/0) hook for etcd/2 2024-09-18 14:12:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-joined (10; unit: easyrsa/0) hook) 2024-09-18 14:12:22 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-09-18 14:12:22.347396726 +0000 UTC 2024-09-18 14:12:28 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-joined (10; unit: easyrsa/0) hook) 2024-09-18 14:12:28 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:12:28 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:12:28 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-joined hook for easyrsa/0 2024-09-18 14:12:28 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:28 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-joined 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.joined tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.egress-subnets 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.ingress-address 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.private-address 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:12:28 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is follower) 2024-09-18 14:12:28 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-18 14:12:28 DEBUG unit.etcd/2.certificates-relation-joined logger.go:60 none 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 27 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:28 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:12:28 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:28 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.available tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: -- dequeue handler reactive/etcd.py:131:missing_relation_notice 2024-09-18 14:12:28 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.client.cert.available tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:29 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:12:29 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:12:29 INFO unit.etcd/2.juju-log server.go:316 certificates:10: status-set: blocked: Missing relation to certificate authority. 2024-09-18 14:12:29 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:12:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:12:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:12:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-joined (10; unit: easyrsa/0) hook) 2024-09-18 14:12:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:12:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:12:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/2 2024-09-18 14:12:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:12:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:12:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:12:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:12:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-18 14:12:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:35 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:12:36 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is follower) 2024-09-18 14:12:36 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-18 14:12:36 DEBUG unit.etcd/2.certificates-relation-changed logger.go:60 none 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 29 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-18 14:12:36 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:36 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:12:36 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:12:36 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:12:36 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:12:36 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:12:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:12:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:12:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:12:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:12:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:12:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:12:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (0; unit: etcd/0) hook for etcd/2 2024-09-18 14:12:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-joined (0; unit: etcd/0) hook) 2024-09-18 14:12:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-joined (0; unit: etcd/0) hook) 2024-09-18 14:12:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (0; unit: etcd/0) hook" for etcd/2 2024-09-18 14:12:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (0; unit: etcd/0) hook" for etcd/2 2024-09-18 14:12:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-joined hook for etcd/0 2024-09-18 14:12:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:40 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-joined 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:12:40 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is follower) 2024-09-18 14:12:40 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-18 14:12:40 DEBUG unit.etcd/2.cluster-relation-joined logger.go:60 none 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 29 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/peers.py:25:peer_joined 2024-09-18 14:12:40 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/etcd/peers.py:25:peer_joined 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag cluster.joined 2024-09-18 14:12:40 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:40 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:12:41 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:12:41 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:12:41 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:12:41 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:12:41 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:12:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (0; unit: etcd/0) hook" for etcd/2 2024-09-18 14:12:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:12:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-joined (0; unit: etcd/0) hook) 2024-09-18 14:12:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:12:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:12:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (0; unit: etcd/0) hook for etcd/2 2024-09-18 14:12:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-18 14:12:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-18 14:12:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/2 2024-09-18 14:12:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/2 2024-09-18 14:12:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for etcd/0 2024-09-18 14:12:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:46 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-changed 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:12:46 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is follower) 2024-09-18 14:12:46 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-18 14:12:46 DEBUG unit.etcd/2.cluster-relation-changed logger.go:60 none 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 30 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-18 14:12:46 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:46 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:12:46 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:12:46 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:12:46 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:12:46 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:12:47 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:12:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/2 2024-09-18 14:12:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:12:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-18 14:12:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:12:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:12:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:12:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:12:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (0; unit: etcd/1) hook for etcd/2 2024-09-18 14:12:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-joined (0; unit: etcd/1) hook) 2024-09-18 14:12:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-joined (0; unit: etcd/1) hook) 2024-09-18 14:12:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (0; unit: etcd/1) hook" for etcd/2 2024-09-18 14:12:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (0; unit: etcd/1) hook" for etcd/2 2024-09-18 14:12:51 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-joined hook for etcd/1 2024-09-18 14:12:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:51 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-joined 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:12:51 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:12:51 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is follower) 2024-09-18 14:12:51 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-18 14:12:52 DEBUG unit.etcd/2.cluster-relation-joined logger.go:60 none 2024-09-18 14:12:52 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 30 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:12:52 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/peers.py:25:peer_joined 2024-09-18 14:12:52 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/etcd/peers.py:25:peer_joined 2024-09-18 14:12:52 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:52 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:12:52 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:12:52 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:12:52 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:12:52 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:12:52 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:12:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (0; unit: etcd/1) hook" for etcd/2 2024-09-18 14:12:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:12:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-joined (0; unit: etcd/1) hook) 2024-09-18 14:12:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:12:52 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:12:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:12:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (0; unit: etcd/1) hook for etcd/2 2024-09-18 14:12:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (0; unit: etcd/1) hook) 2024-09-18 14:12:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (0; unit: etcd/1) hook) 2024-09-18 14:12:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (0; unit: etcd/1) hook" for etcd/2 2024-09-18 14:12:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (0; unit: etcd/1) hook" for etcd/2 2024-09-18 14:12:59 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for etcd/1 2024-09-18 14:12:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:12:59 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-changed 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-18 14:12:59 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:13:00 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:13:00 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is follower) 2024-09-18 14:13:00 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-18 14:13:00 DEBUG unit.etcd/2.cluster-relation-changed logger.go:60 none 2024-09-18 14:13:00 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 30 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:13:00 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-18 14:13:00 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:00 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:13:00 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:13:00 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:13:00 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:13:00 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:13:00 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:13:00 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (0; unit: etcd/1) hook" for etcd/2 2024-09-18 14:13:00 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:13:00 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (0; unit: etcd/1) hook) 2024-09-18 14:13:00 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:13:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:13:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:13:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:13:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (8; unit: kubernetes-master/0) hook for etcd/2 2024-09-18 14:13:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-joined (8; unit: kubernetes-master/0) hook) 2024-09-18 14:13:02 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 14:13:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-joined (8; unit: kubernetes-master/0) hook) 2024-09-18 14:13:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (8; unit: kubernetes-master/0) hook" for etcd/2 2024-09-18 14:13:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (8; unit: kubernetes-master/0) hook" for etcd/2 2024-09-18 14:13:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-joined hook for kubernetes-master/0 2024-09-18 14:13:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:13:05 INFO unit.etcd/2.juju-log server.go:316 db:8: Reactive main running for hook db-relation-joined 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:13:05 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Leadership Layer (is follower) 2024-09-18 14:13:05 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-18 14:13:05 DEBUG unit.etcd/2.db-relation-joined logger.go:60 none 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 30 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:05 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag db.connected 2024-09-18 14:13:05 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:05 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:13:06 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:13:06 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:13:06 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:13:06 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:13:06 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:13:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (8; unit: kubernetes-master/0) hook" for etcd/2 2024-09-18 14:13:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:13:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-joined (8; unit: kubernetes-master/0) hook) 2024-09-18 14:13:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:13:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:13:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:13:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:13:06 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (8; unit: kubernetes-master/0) hook for etcd/2 2024-09-18 14:13:06 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (8; unit: kubernetes-master/0) hook) 2024-09-18 14:13:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (8; unit: kubernetes-master/0) hook) 2024-09-18 14:13:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (8; unit: kubernetes-master/0) hook" for etcd/2 2024-09-18 14:13:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (8; unit: kubernetes-master/0) hook" for etcd/2 2024-09-18 14:13:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-changed hook for kubernetes-master/0 2024-09-18 14:13:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:13:11 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {10 {map[easyrsa/0:{1}] map[] []}} 2024-09-18 14:13:11 INFO unit.etcd/2.juju-log server.go:316 db:8: Reactive main running for hook db-relation-changed 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:13:11 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Leadership Layer (is follower) 2024-09-18 14:13:11 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-18 14:13:11 DEBUG unit.etcd/2.db-relation-changed logger.go:60 none 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 31 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:11 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:11 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:11 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:13:12 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:13:12 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:13:12 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:13:12 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:13:12 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:13:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (8; unit: kubernetes-master/0) hook" for etcd/2 2024-09-18 14:13:12 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:13:12 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (8; unit: kubernetes-master/0) hook) 2024-09-18 14:13:12 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:13:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:13:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:13:12 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/2 2024-09-18 14:13:12 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:13:17 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:13:17 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:13:17 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:13:17 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-18 14:13:17 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:13:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.changed.ca tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.client.cert 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.client.key 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:13:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is follower) 2024-09-18 14:13:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-18 14:13:17 DEBUG unit.etcd/2.certificates-relation-changed logger.go:60 none 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 34 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-18 14:13:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:13:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:13:18 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:13:18 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:13:18 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Writing client certificate to /var/snap/etcd/common/client.crt 2024-09-18 14:13:18 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.client.certificate.written 2024-09-18 14:13:18 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.client.certificate.saved 2024-09-18 14:13:18 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Writing client key to /var/snap/etcd/common/client.key 2024-09-18 14:13:18 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.client.key.saved 2024-09-18 14:13:18 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:13:18 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.ca.available tracer: ++ queue handler reactive/tls_client.py:18:store_ca 2024-09-18 14:13:18 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag certificates.ca.changed 2024-09-18 14:13:18 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:13:18 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Writing CA certificate to /var/snap/etcd/common/ca.crt 2024-09-18 14:13:18 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.ca.written 2024-09-18 14:13:18 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.ca.saved 2024-09-18 14:13:18 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Writing CA certificate to /usr/local/share/ca-certificates/etcd.crt 2024-09-18 14:13:18 DEBUG unit.etcd/2.certificates-relation-changed logger.go:60 Updating certificates in /etc/ssl/certs... 2024-09-18 14:13:18 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-18 14:13:18 DEBUG unit.etcd/2.certificates-relation-changed logger.go:60 1 added, 0 removed; done. 2024-09-18 14:13:18 DEBUG unit.etcd/2.certificates-relation-changed logger.go:60 Running hooks in /etc/ca-certificates/update.d... 2024-09-18 14:13:18 DEBUG unit.etcd/2.certificates-relation-changed logger.go:60 done. 2024-09-18 14:13:18 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Generated ca-certificates.crt for etcd 2024-09-18 14:13:18 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.ca_installed 2024-09-18 14:13:19 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:13:19 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:13:19 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:13:19 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:13:19 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:13:19 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:13:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:13:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (8; unit: kubernetes-master/1) hook for etcd/2 2024-09-18 14:13:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-joined (8; unit: kubernetes-master/1) hook) 2024-09-18 14:13:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-joined (8; unit: kubernetes-master/1) hook) 2024-09-18 14:13:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (8; unit: kubernetes-master/1) hook" for etcd/2 2024-09-18 14:13:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (8; unit: kubernetes-master/1) hook" for etcd/2 2024-09-18 14:13:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-joined hook for kubernetes-master/1 2024-09-18 14:13:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:13:25 INFO unit.etcd/2.juju-log server.go:316 db:8: Reactive main running for hook db-relation-joined 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:13:25 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Leadership Layer (is follower) 2024-09-18 14:13:25 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-18 14:13:25 DEBUG unit.etcd/2.db-relation-joined logger.go:60 none 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 42 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.ca.changed tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:25 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:25 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:25 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:13:25 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:13:26 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:13:26 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:13:26 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:13:26 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:13:26 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: cleared flag certificates.ca.changed 2024-09-18 14:13:26 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:13:26 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (8; unit: kubernetes-master/1) hook" for etcd/2 2024-09-18 14:13:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:13:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-joined (8; unit: kubernetes-master/1) hook) 2024-09-18 14:13:26 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:13:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:13:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (8; unit: kubernetes-master/1) hook for etcd/2 2024-09-18 14:13:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (8; unit: kubernetes-master/1) hook) 2024-09-18 14:13:26 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {0 {map[etcd/0:{1}] map[] []}} 2024-09-18 14:13:28 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {0 {map[etcd/1:{1}] map[] []}} 2024-09-18 14:13:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (8; unit: kubernetes-master/1) hook) 2024-09-18 14:13:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (8; unit: kubernetes-master/1) hook" for etcd/2 2024-09-18 14:13:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (8; unit: kubernetes-master/1) hook" for etcd/2 2024-09-18 14:13:34 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-changed hook for kubernetes-master/1 2024-09-18 14:13:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Reactive main running for hook db-relation-changed 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Leadership Layer (is follower) 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-18 14:13:34 DEBUG unit.etcd/2.db-relation-changed logger.go:60 none 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 41 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:34 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:13:34 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:13:35 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:13:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (8; unit: kubernetes-master/1) hook" for etcd/2 2024-09-18 14:13:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:13:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (8; unit: kubernetes-master/1) hook) 2024-09-18 14:13:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:13:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:13:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:13:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:13:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:13:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (0; unit: etcd/0) hook for etcd/2 2024-09-18 14:13:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-18 14:13:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-18 14:13:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/2 2024-09-18 14:13:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/2 2024-09-18 14:13:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for etcd/0 2024-09-18 14:13:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:13:41 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-changed 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:13:41 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:13:42 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is follower) 2024-09-18 14:13:42 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-18 14:13:42 DEBUG unit.etcd/2.cluster-relation-changed logger.go:60 none 2024-09-18 14:13:42 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 41 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:13:42 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-18 14:13:42 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:42 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:13:42 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:13:42 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:13:42 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:13:42 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:13:42 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:13:42 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:13:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/2 2024-09-18 14:13:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:13:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-18 14:13:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:13:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:13:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:13:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:13:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:13:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (0; unit: etcd/1) hook for etcd/2 2024-09-18 14:13:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (0; unit: etcd/1) hook) 2024-09-18 14:13:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (0; unit: etcd/1) hook) 2024-09-18 14:13:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (0; unit: etcd/1) hook" for etcd/2 2024-09-18 14:13:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (0; unit: etcd/1) hook" for etcd/2 2024-09-18 14:13:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for etcd/1 2024-09-18 14:13:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:13:47 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-changed 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-18 14:13:47 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-18 14:13:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-18 14:13:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:13:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:13:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is follower) 2024-09-18 14:13:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-18 14:13:48 DEBUG unit.etcd/2.cluster-relation-changed logger.go:60 none 2024-09-18 14:13:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 41 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:13:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-18 14:13:48 DEBUG unit.etcd/2.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:13:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:13:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:13:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:13:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:13:48 INFO unit.etcd/2.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:13:48 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:13:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (0; unit: etcd/1) hook" for etcd/2 2024-09-18 14:13:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:13:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (0; unit: etcd/1) hook) 2024-09-18 14:13:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:13:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:13:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:13:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:13:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:13:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:13:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:13:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (8; unit: kubernetes-master/2) hook for etcd/2 2024-09-18 14:13:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-joined (8; unit: kubernetes-master/2) hook) 2024-09-18 14:13:54 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-joined (8; unit: kubernetes-master/2) hook) 2024-09-18 14:13:54 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (8; unit: kubernetes-master/2) hook" for etcd/2 2024-09-18 14:13:55 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (8; unit: kubernetes-master/2) hook" for etcd/2 2024-09-18 14:13:55 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-joined hook for kubernetes-master/2 2024-09-18 14:13:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Reactive main running for hook db-relation-joined 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Leadership Layer (is follower) 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-18 14:13:55 DEBUG unit.etcd/2.db-relation-joined logger.go:60 none 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 41 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:13:55 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:13:55 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:13:56 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-joined" hook (via explicit, bespoke hook script) 2024-09-18 14:13:56 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (8; unit: kubernetes-master/2) hook" for etcd/2 2024-09-18 14:13:56 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:13:56 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-joined (8; unit: kubernetes-master/2) hook) 2024-09-18 14:13:56 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:13:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:13:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:13:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:13:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (8; unit: kubernetes-master/2) hook for etcd/2 2024-09-18 14:13:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (8; unit: kubernetes-master/2) hook) 2024-09-18 14:14:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (8; unit: kubernetes-master/2) hook) 2024-09-18 14:14:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (8; unit: kubernetes-master/2) hook" for etcd/2 2024-09-18 14:14:03 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (8; unit: kubernetes-master/2) hook" for etcd/2 2024-09-18 14:14:03 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-changed hook for kubernetes-master/2 2024-09-18 14:14:03 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:14:03 INFO unit.etcd/2.juju-log server.go:316 db:8: Reactive main running for hook db-relation-changed 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:14:03 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Leadership Layer (is follower) 2024-09-18 14:14:03 INFO unit.etcd/2.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-18 14:14:03 DEBUG unit.etcd/2.db-relation-changed logger.go:60 none 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 41 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:14:03 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-18 14:14:03 DEBUG unit.etcd/2.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:14:03 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:14:03 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:14:04 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:14:04 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:14:04 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:14:04 INFO unit.etcd/2.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:14:04 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:14:04 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (8; unit: kubernetes-master/2) hook" for etcd/2 2024-09-18 14:14:04 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:14:04 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (8; unit: kubernetes-master/2) hook) 2024-09-18 14:14:04 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:14:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:14:04 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:14:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:14:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:14:07 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {10 {map[easyrsa/0:{2}] map[] []}} 2024-09-18 14:14:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:14:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:14:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/2 2024-09-18 14:14:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:14:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:14:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:14:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:14:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-18 14:14:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:14:11 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.etcd_0.server.key 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:14:12 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is follower) 2024-09-18 14:14:12 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-18 14:14:12 DEBUG unit.etcd/2.certificates-relation-changed logger.go:60 none 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 43 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-18 14:14:12 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:14:12 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:14:12 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:14:12 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:14:12 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:14:12 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:14:12 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:14:12 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:14:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:14:12 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:14:12 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:14:12 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:14:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:14:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:14:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:14:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:14:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:14:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:14:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:14:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:14:20 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-09-18 14:14:26 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/2: ok=true 2024-09-18 14:14:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for etcd/2 2024-09-18 14:14:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run leader-settings-changed hook) 2024-09-18 14:14:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run leader-settings-changed hook) 2024-09-18 14:14:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for etcd/2 2024-09-18 14:14:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for etcd/2 2024-09-18 14:14:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-09-18 14:14:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:14:29 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:14:29 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag leadership.changed.cluster 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag leadership.set.cluster 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag leadership.changed.leader_address 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag leadership.set.leader_address 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-09-18 14:14:29 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:14:29 DEBUG unit.etcd/2.leader-settings-changed logger.go:60 none 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 48 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster tracer: set flag leadership.changed.leader_address tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:14:29 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:14:30 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:14:30 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:14:30 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:14:30 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:14:30 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:14:30 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:14:30 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:14:30 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:14:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for etcd/2 2024-09-18 14:14:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:14:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run leader-settings-changed hook) 2024-09-18 14:14:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:14:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:14:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:14:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:14:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:14:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:14:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:14:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:14:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:16:13 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {10 {map[easyrsa/0:{3}] map[] []}} 2024-09-18 14:16:13 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:16:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:16:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:16:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:16:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:16:13 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/2 2024-09-18 14:16:13 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:16:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:16:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:16:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:16:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-18 14:16:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:16:16 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.etcd_1.server.key 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:16:16 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:16:16 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is follower) 2024-09-18 14:16:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: cleared flag leadership.changed.cluster 2024-09-18 14:16:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: cleared flag leadership.changed.leader_address 2024-09-18 14:16:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: cleared flag leadership.changed 2024-09-18 14:16:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-18 14:16:17 DEBUG unit.etcd/2.certificates-relation-changed logger.go:60 none 2024-09-18 14:16:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:16:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-18 14:16:17 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:16:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:16:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:16:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:16:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:16:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:16:17 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:16:17 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:16:17 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:16:17 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:16:17 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:16:17 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:16:17 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:16:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:16:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:16:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:16:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:16:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:16:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:16:17 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:16:39 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/2 : {10 {map[easyrsa/0:{4}] map[] []}} 2024-09-18 14:16:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:16:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:16:39 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/2 2024-09-18 14:16:39 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:16:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:16:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:16:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:16:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-18 14:16:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:16:40 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.etcd_2.server.key 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-18 14:16:40 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is follower) 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-18 14:16:41 DEBUG unit.etcd/2.certificates-relation-changed logger.go:60 none 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 49 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag certificates.server.certs.available 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag certificates.server.certs.changed 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag certificates.certs.available 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.certs.changed tracer: ++ queue handler reactive/tls_client.py:98:update_certs 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.server.cert.available tracer: ++ queue handler reactive/tls_client.py:44:store_server 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag certificates.batch.cert.available 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Writing server certificate to /var/snap/etcd/common/server.crt 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.server.certificate.written 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.server.certificate.saved 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Writing server key to /var/snap/etcd/common/server.key 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.server.key.saved 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:98:update_certs 2024-09-18 14:16:41 WARNING unit.etcd/2.juju-log server.go:316 certificates:10: No client certs found using maps. Checking for global client certificates. 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: set flag tls_client.certs.saved 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: cleared flag certificates.certs.changed tracer: -- dequeue handler reactive/tls_client.py:98:update_certs 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:530:tls_state_control 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:549:tls_update tracer: -- dequeue handler reactive/etcd.py:530:tls_state_control 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:399:register_node_with_leader 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: Writing file /var/snap/etcd/common/etcd.conf.yml root:root 444 2024-09-18 14:16:41 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag etcd.registered tracer: -- dequeue handler reactive/etcd.py:399:register_node_with_leader 2024-09-18 14:16:41 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:549:tls_update 2024-09-18 14:16:42 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: Changing permissions on existing content: 33060 -> 292 2024-09-18 14:16:42 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: cleared flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:530:tls_state_control tracer: -- dequeue handler reactive/etcd.py:254:send_cluster_connection_details tracer: -- dequeue handler reactive/etcd.py:549:tls_update 2024-09-18 14:16:42 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: cleared flag tls_client.ca.written 2024-09-18 14:16:42 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: cleared flag tls_client.server.certificate.written 2024-09-18 14:16:42 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer: cleared flag tls_client.client.certificate.written 2024-09-18 14:16:42 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:16:42 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 Error: client: etcd cluster is unavailable or misconfigured; error #0: dial tcp 127.0.0.1:4001: connect: connection refused 2024-09-18 14:16:42 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 ; error #1: dial tcp 127.0.0.1:2379: connect: connection refused 2024-09-18 14:16:42 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 2024-09-18 14:16:42 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 error #0: dial tcp 127.0.0.1:4001: connect: connection refused 2024-09-18 14:16:42 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 error #1: dial tcp 127.0.0.1:2379: connect: connection refused 2024-09-18 14:16:42 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 2024-09-18 14:16:42 ERROR unit.etcd/2.juju-log server.go:316 certificates:10: ['/snap/bin/etcd.etcdctl', 'cluster-health'] 2024-09-18 14:16:42 ERROR unit.etcd/2.juju-log server.go:316 certificates:10: {'ETCDCTL_API': '2', 'ETCDCTL_CA_FILE': '/var/snap/etcd/common/ca.crt', 'ETCDCTL_CERT_FILE': '/var/snap/etcd/common/server.crt', 'ETCDCTL_KEY_FILE': '/var/snap/etcd/common/server.key'} 2024-09-18 14:16:42 ERROR unit.etcd/2.juju-log server.go:316 certificates:10: b'cluster may be unhealthy: failed to list members\n' 2024-09-18 14:16:42 ERROR unit.etcd/2.juju-log server.go:316 certificates:10: None 2024-09-18 14:16:42 WARNING unit.etcd/2.juju-log server.go:316 certificates:10: Notice: Unit failed cluster-health check 2024-09-18 14:16:42 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:530:tls_state_control 2024-09-18 14:16:42 DEBUG unit.etcd/2.juju-log server.go:316 certificates:10: tracer> tracer: set flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: -- dequeue handler reactive/etcd.py:530:tls_state_control 2024-09-18 14:16:42 INFO unit.etcd/2.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:16:42 INFO unit.etcd/2.juju-log server.go:316 certificates:10: status-set: active: UnHealthy with 3 known peers 2024-09-18 14:16:42 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:16:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/2 2024-09-18 14:16:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:16:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-18 14:16:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:16:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:16:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:16:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:16:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:16:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:16:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:16:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:16:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:18:40 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 14:18:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:18:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:18:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:18:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:18:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:18:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:18:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:18:40 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 14:18:40 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 14:18:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 14:18:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 14:18:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 14:18:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:18:44 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:18:44 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:18:44 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:18:44 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 57 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag certificates.server.certs.changed tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:18:44 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:18:44 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:18:45 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:18:45 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:18:45 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:18:45 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:18:45 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:18:45 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:18:45 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:18:45 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:18:45 DEBUG unit.etcd/2.juju-log server.go:316 tracer: cleared flag certificates.server.certs.changed 2024-09-18 14:18:45 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 14:18:45 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:18:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 14:18:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:18:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 14:18:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:18:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:18:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:18:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:18:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:18:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:18:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:18:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:19:55 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/2: ok=true 2024-09-18 14:19:55 DEBUG juju.worker.retrystrategy worker.go:92 bouncing retrystrategy worker to get new values 2024-09-18 14:19:55 DEBUG juju.worker.dependency engine.go:621 "hook-retry-strategy" manifold worker stopped: restart immediately 2024-09-18 14:19:55 INFO juju.worker.uniter uniter.go:319 unit "etcd/2" shutting down: catacomb 0xc000652480 is dying 2024-09-18 14:19:55 DEBUG juju.worker.uniter runlistener.go:130 juju-run listener stopping 2024-09-18 14:19:55 DEBUG juju.worker.uniter runlistener.go:149 juju-run listener stopped 2024-09-18 14:19:55 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-09-18 14:19:55.696685831 +0000 UTC 2024-09-18 14:19:55 DEBUG juju.worker.dependency engine.go:603 "uniter" manifold worker completed successfully 2024-09-18 14:19:55 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-09-18 14:19:55.906254081 +0000 UTC 2024-09-18 14:19:56 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/2" (leader=false) entered scope for relation "etcd:cluster" 2024-09-18 14:19:56 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/2" (leader=false) entered scope for relation "etcd:certificates easyrsa:client" 2024-09-18 14:19:57 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/2" (leader=false) entered scope for relation "kubernetes-master:etcd etcd:db" 2024-09-18 14:19:57 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-etcd-2/run.socket } 2024-09-18 14:19:57 INFO juju.worker.uniter uniter.go:335 unit "etcd/2" started 2024-09-18 14:19:57 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-09-18 14:19:57 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2024-09-18 14:19:57 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/2: ok=true 2024-09-18 14:19:57 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for etcd/2: [] ok=true 2024-09-18 14:19:57 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for etcd/2: ok=true 2024-09-18 14:19:57 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for etcd/2: ok=true, hashes=[3d2b77b64443168147f6713dab1931525b04213f4586c54a045733009b82788b] 2024-09-18 14:19:57 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/2: ok=true 2024-09-18 14:19:57 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for etcd/2 2024-09-18 14:19:58 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for etcd/2: ok=true, hashes=[51e9e2593d2d2d48099fb3c0fe9760058a9f2043cb2eddd9a7a27cc5b8850729] 2024-09-18 14:19:58 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for etcd/2: ok=true, hashes=[17f2acda51310eebc7ec5fc33ba3e24c9838f484cf50956f7b6066f1d8bba28f] 2024-09-18 14:19:58 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for etcd/2: [] ok=true 2024-09-18 14:19:58 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for etcd/2 2024-09-18 14:19:58 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-09-18 14:19:58 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-09-18 14:19:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for etcd/2 2024-09-18 14:19:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run leader-settings-changed hook) 2024-09-18 14:19:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run leader-settings-changed hook) 2024-09-18 14:19:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for etcd/2 2024-09-18 14:19:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for etcd/2 2024-09-18 14:19:59 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-09-18 14:19:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:19:59 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-09-18 14:19:59 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:19:59 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:19:59 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:19:59 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:19:59 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:20:00 DEBUG unit.etcd/2.leader-settings-changed logger.go:60 none 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:20:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:20:00 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 14:20:01 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-09-18 14:20:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for etcd/2 2024-09-18 14:20:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:20:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run leader-settings-changed hook) 2024-09-18 14:20:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:20:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:20:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:20:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:20:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:20:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:20:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:20:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:20:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-18 14:25:19 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 14:25:19 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:25:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:25:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:25:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:25:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:25:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:25:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:25:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 14:25:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 14:25:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 14:25:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 14:25:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 14:25:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:25:49 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:25:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:25:49 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 14:25:50 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:25:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 14:25:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:25:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 14:25:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:25:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:25:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:25:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:25:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:25:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:25:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:25:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:30:55 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 14:30:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:30:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:30:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:30:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:30:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:30:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:30:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:30:55 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 14:30:55 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 14:30:55 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 14:30:55 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 14:30:55 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 14:30:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:30:55 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 14:30:55 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:30:55 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:30:55 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:30:55 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:30:56 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:30:56 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:30:56 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 14:30:57 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:30:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 14:30:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:30:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 14:30:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:30:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:30:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:30:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:30:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:30:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:30:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:30:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:35:00 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 14:35:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:35:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:35:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:35:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:35:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:35:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:35:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:35:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 14:35:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 14:35:08 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 14:35:08 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 14:35:08 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 14:35:08 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:35:08 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 14:35:08 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:35:08 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:35:09 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:35:09 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:35:09 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:35:09 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:35:09 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:35:09 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:35:11 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:35:11 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:35:11 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:35:11 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:35:11 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:35:11 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:35:11 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:35:11 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 14:35:11 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:35:11 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 14:35:11 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:35:11 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 14:35:11 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:35:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:35:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:35:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:35:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:35:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:35:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:35:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:40:26 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 14:40:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:40:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:40:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:40:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:40:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:40:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:40:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:40:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 14:40:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 14:40:26 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 14:40:26 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 14:40:26 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 14:40:26 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:40:26 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:40:26 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:40:26 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:40:26 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:40:26 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:40:26 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:40:27 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:40:27 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:40:27 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:40:27 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:40:27 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:40:27 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:40:27 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:40:27 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:40:27 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 14:40:28 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:40:28 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 14:40:28 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:40:28 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 14:40:28 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:40:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:40:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:40:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:40:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:40:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:40:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:40:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:46:14 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 14:46:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:46:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:46:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:46:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:46:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:46:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:46:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:46:14 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 14:46:14 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 14:46:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 14:46:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 14:46:14 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 14:46:14 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:46:14 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:46:14 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:46:14 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:46:14 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:46:14 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:46:14 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:46:15 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:46:15 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:46:15 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:46:15 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:46:15 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:46:15 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:46:15 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:46:15 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:46:15 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 14:46:15 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:46:15 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 14:46:15 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:46:15 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 14:46:15 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:46:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:46:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:46:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:46:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:46:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:46:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:46:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:51:00 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 14:51:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:51:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:51:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:51:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:51:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:51:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:51:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:51:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 14:51:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 14:51:00 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 14:51:00 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 14:51:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 14:51:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:51:00 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:51:00 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:51:00 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:51:00 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:51:00 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:51:00 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:51:01 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:51:01 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:51:01 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:51:01 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:51:01 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:51:01 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:51:01 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:51:01 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:51:01 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 14:51:01 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:51:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 14:51:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:51:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 14:51:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:51:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:51:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:56:05 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 14:56:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:56:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:56:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:56:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:56:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:56:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:56:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 14:56:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 14:56:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 14:56:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 14:56:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 14:56:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 14:56:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 14:56:06 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 14:56:06 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 14:56:06 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 14:56:06 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 14:56:06 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 14:56:06 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 14:56:06 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 14:56:06 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 14:56:06 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 14:56:06 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 14:56:07 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 14:56:07 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 14:56:07 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 14:56:07 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 14:56:07 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 14:56:07 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 14:56:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 14:56:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 14:56:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 14:56:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 14:56:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 14:56:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 14:56:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 14:56:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 14:56:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 14:56:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 14:56:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:00:34 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 15:00:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:00:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:00:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:00:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:00:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:00:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:00:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:00:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 15:00:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 15:00:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 15:00:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 15:00:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 15:00:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 15:00:34 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 15:00:34 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 15:00:34 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 15:00:34 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 15:00:34 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:00:34 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 15:00:35 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 15:00:35 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 15:00:35 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 15:00:35 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 15:00:35 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 15:00:35 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 15:00:35 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 15:00:35 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 15:00:35 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 15:00:35 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:00:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 15:00:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:00:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 15:00:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 15:00:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:00:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:00:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:00:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:00:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:00:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:00:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 15:05:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:05:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:05:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:05:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:05:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:05:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:05:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:05:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 15:05:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 15:05:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 15:05:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 15:05:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 15:05:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 15:05:20 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 15:05:21 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 15:05:21 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 15:05:21 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 15:05:21 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:05:21 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 15:05:21 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 15:05:21 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 15:05:21 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 15:05:21 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 15:05:21 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 15:05:22 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 15:05:22 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 15:05:22 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 15:05:22 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 15:05:22 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:05:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 15:05:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:05:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 15:05:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 15:05:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:05:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:05:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:05:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:05:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:05:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:05:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:09:43 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 15:09:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:09:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:09:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 15:09:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 15:09:45 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 15:09:45 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 15:09:45 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 15:09:45 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 15:09:46 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 15:09:46 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 15:09:46 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 15:09:46 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 15:09:46 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:09:46 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 15:09:46 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 15:09:46 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 15:09:46 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 15:09:46 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 15:09:47 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 15:09:47 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 15:09:47 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 15:09:47 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 15:09:47 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 15:09:47 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:09:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 15:09:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:09:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 15:09:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 15:09:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:09:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:09:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:09:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:09:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:09:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:09:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:14:42 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 15:14:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:14:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:14:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:14:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:14:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:14:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:14:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:14:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 15:14:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 15:14:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 15:14:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 15:14:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 15:14:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 15:14:43 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 15:14:43 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 15:14:43 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 15:14:43 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 15:14:43 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:14:43 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 15:14:43 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 15:14:43 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 15:14:44 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 15:14:44 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 15:14:44 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 15:14:44 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 15:14:44 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 15:14:44 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 15:14:44 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 15:14:44 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:14:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 15:14:44 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:14:44 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 15:14:44 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 15:14:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:18:49 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 15:18:49 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:18:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:18:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:18:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:18:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:18:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:18:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:18:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 15:18:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 15:18:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 15:18:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 15:18:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 15:18:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 15:18:49 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 15:18:49 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 15:18:49 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 15:18:49 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 15:18:49 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:18:49 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 15:18:50 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 15:18:50 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 15:18:50 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 15:18:50 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 15:18:50 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 15:18:50 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 15:18:50 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 15:18:50 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 15:18:50 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 15:18:50 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:18:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 15:18:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:18:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 15:18:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 15:18:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:18:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:18:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:18:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:18:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:18:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:18:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:23:04 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/2 2024-09-18 15:23:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:23:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:23:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0 2024-09-18 15:23:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:23:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:23:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:23:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:23:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/2 2024-09-18 15:23:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/2 uniter (run update-status hook) 2024-09-18 15:23:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/2 uniter (run update-status hook) 2024-09-18 15:23:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/2 2024-09-18 15:23:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/2 2024-09-18 15:23:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-2/agent.socket } 2024-09-18 15:23:04 INFO unit.etcd/2.juju-log server.go:316 Reactive main running for hook update-status 2024-09-18 15:23:04 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:23:04 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-18 15:23:04 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.port 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.port 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Initializing Snap Layer 2024-09-18 15:23:05 DEBUG unit.etcd/2.update-status logger.go:60 none 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 56 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-18 15:23:05 DEBUG unit.etcd/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-18 15:23:05 INFO unit.etcd/2.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-18 15:23:06 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-18 15:23:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/2 2024-09-18 15:23:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-18 15:23:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/2 uniter (run update-status hook) 2024-09-18 15:23:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/2 2024-09-18 15:23:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-18 15:23:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-18 15:23:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-18 15:23:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-18 15:23:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-18 15:23:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-18 15:23:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/1" already joined relation 0