2026-10-26 02:27:31.771233+00:00 [notice] <0.222.0> Logging: configured log handlers are now ACTIVE
2026-10-26 02:27:31.982831+00:00 [info] <0.222.0> ra: starting system quorum_queues
2026-10-26 02:27:31.982987+00:00 [info] <0.222.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/quorum/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2
2026-10-26 02:27:32.064705+00:00 [info] <0.259.0> ra system 'quorum_queues' running pre init for 0 registered servers
2026-10-26 02:27:32.105186+00:00 [info] <0.260.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2026-10-26 02:27:32.120975+00:00 [notice] <0.265.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2026-10-26 02:27:32.206102+00:00 [info] <0.222.0> ra: starting system coordination
2026-10-26 02:27:32.206191+00:00 [info] <0.222.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/coordination/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2
2026-10-26 02:27:32.207247+00:00 [info] <0.272.0> ra system 'coordination' running pre init for 0 registered servers
2026-10-26 02:27:32.219939+00:00 [info] <0.273.0> ra: meta data store initialised for system coordination. 0 record(s) recovered
2026-10-26 02:27:32.220617+00:00 [notice] <0.278.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2026-10-26 02:27:32.225666+00:00 [info] <0.222.0> 
2026-10-26 02:27:32.225666+00:00 [info] <0.222.0>  Starting RabbitMQ 3.10.7 on Erlang 25.0.4 [jit]
2026-10-26 02:27:32.225666+00:00 [info] <0.222.0>  Copyright (c) 2007-2022 VMware, Inc. or its affiliates.
2026-10-26 02:27:32.225666+00:00 [info] <0.222.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0> 
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0>  node           : contrail@cn-jenkins-deploy-platform-ansible-os-6403-2
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0>  home dir       : /var/lib/rabbitmq
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0>  config file(s) : /etc/rabbitmq/rabbitmq.config
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0>                 : /etc/rabbitmq/conf.d/10-defaults.conf
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0>  cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0>  log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0>                 : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2_upgrade.log
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0>                 : <stdout>
2026-10-26 02:27:32.227128+00:00 [info] <0.222.0>  database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2
2026-10-26 02:27:32.514611+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-10-26 02:27:32.514703+00:00 [info] <0.222.0> Feature flags:   [ ] classic_mirrored_queue_version
2026-10-26 02:27:32.514733+00:00 [info] <0.222.0> Feature flags:   [ ] drop_unroutable_metric
2026-10-26 02:27:32.514766+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2026-10-26 02:27:32.514793+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-10-26 02:27:32.514814+00:00 [info] <0.222.0> Feature flags:   [ ] maintenance_mode_status
2026-10-26 02:27:32.514838+00:00 [info] <0.222.0> Feature flags:   [ ] quorum_queue
2026-10-26 02:27:32.514921+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-10-26 02:27:32.514968+00:00 [info] <0.222.0> Feature flags:   [ ] user_limits
2026-10-26 02:27:32.514990+00:00 [info] <0.222.0> Feature flags:   [ ] virtual_host_metadata
2026-10-26 02:27:32.515024+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-10-26 02:27:34.865806+00:00 [info] <0.222.0> Running boot step pre_boot defined by app rabbit
2026-10-26 02:27:34.865900+00:00 [info] <0.222.0> Running boot step rabbit_global_counters defined by app rabbit
2026-10-26 02:27:34.866364+00:00 [info] <0.222.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2026-10-26 02:27:34.866525+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics defined by app rabbit
2026-10-26 02:27:34.867256+00:00 [info] <0.222.0> Running boot step rabbit_alarm defined by app rabbit
2026-10-26 02:27:34.871808+00:00 [info] <0.300.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total
2026-10-26 02:27:34.875900+00:00 [info] <0.302.0> Enabling free disk space monitoring
2026-10-26 02:27:34.875976+00:00 [info] <0.302.0> Disk free limit set to 50MB
2026-10-26 02:27:34.879198+00:00 [info] <0.222.0> Running boot step code_server_cache defined by app rabbit
2026-10-26 02:27:34.879363+00:00 [info] <0.222.0> Running boot step file_handle_cache defined by app rabbit
2026-10-26 02:27:34.879585+00:00 [info] <0.307.0> Limiting to approx 927 file handles (832 sockets)
2026-10-26 02:27:34.879713+00:00 [info] <0.308.0> FHC read buffering: OFF
2026-10-26 02:27:34.879751+00:00 [info] <0.308.0> FHC write buffering: ON
2026-10-26 02:27:34.880078+00:00 [info] <0.222.0> Running boot step worker_pool defined by app rabbit
2026-10-26 02:27:34.880151+00:00 [info] <0.280.0> Will use 4 processes for default worker pool
2026-10-26 02:27:34.880191+00:00 [info] <0.280.0> Starting worker pool 'worker_pool' with 4 processes in it
2026-10-26 02:27:34.880531+00:00 [info] <0.222.0> Running boot step database defined by app rabbit
2026-10-26 02:27:34.880868+00:00 [info] <0.222.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2 is empty. Assuming we need to join an existing cluster or initialise from scratch...
2026-10-26 02:27:34.880932+00:00 [info] <0.222.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config
2026-10-26 02:27:34.880962+00:00 [info] <0.222.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config
2026-10-26 02:27:44.083385+00:00 [info] <0.222.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-6403-1, contrail@cn-jenkins-deploy-platform-ansible-os-6403-2, contrail@cn-jenkins-deploy-platform-ansible-os-6403-3
2026-10-26 02:27:44.083511+00:00 [info] <0.222.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-6403-1, contrail@cn-jenkins-deploy-platform-ansible-os-6403-3
2026-10-26 02:27:44.087172+00:00 [info] <0.222.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-1' selected for auto-clustering
2026-10-26 02:27:44.114888+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:27:44.115072+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-10-26 02:27:44.590578+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:27:44.590728+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-10-26 02:27:44.590787+00:00 [warning] <0.222.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2-feature_flags`:
2026-10-26 02:27:44.590827+00:00 [warning] <0.222.0> Feature flags:   - list of previously enabled feature flags now marked as such: [maintenance_mode_status,
2026-10-26 02:27:44.590827+00:00 [warning] <0.222.0>                                                                                  quorum_queue,
2026-10-26 02:27:44.590827+00:00 [warning] <0.222.0>                                                                                  user_limits,
2026-10-26 02:27:44.590827+00:00 [warning] <0.222.0>                                                                                  virtual_host_metadata]
2026-10-26 02:27:44.592820+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-10-26 02:27:44.592883+00:00 [info] <0.222.0> Feature flags:   [ ] classic_mirrored_queue_version
2026-10-26 02:27:44.592919+00:00 [info] <0.222.0> Feature flags:   [ ] drop_unroutable_metric
2026-10-26 02:27:44.592962+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2026-10-26 02:27:44.593033+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-10-26 02:27:44.593065+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-10-26 02:27:44.593089+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-10-26 02:27:44.593174+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-10-26 02:27:44.593198+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-10-26 02:27:44.593216+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-10-26 02:27:44.593244+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-10-26 02:27:44.603799+00:00 [info] <0.222.0> Feature flag `classic_mirrored_queue_version`: mark as enabled=true
2026-10-26 02:27:44.628250+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-10-26 02:27:44.628348+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-10-26 02:27:44.628375+00:00 [info] <0.222.0> Feature flags:   [ ] drop_unroutable_metric
2026-10-26 02:27:44.628410+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2026-10-26 02:27:44.628493+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-10-26 02:27:44.628517+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-10-26 02:27:44.628537+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-10-26 02:27:44.628557+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-10-26 02:27:44.628613+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-10-26 02:27:44.628631+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-10-26 02:27:44.628661+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-10-26 02:27:44.637309+00:00 [info] <0.222.0> Feature flag `drop_unroutable_metric`: mark as enabled=true
2026-10-26 02:27:44.639028+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-10-26 02:27:44.639099+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-10-26 02:27:44.639125+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-10-26 02:27:44.639162+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2026-10-26 02:27:44.639184+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-10-26 02:27:44.639208+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-10-26 02:27:44.639250+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-10-26 02:27:44.639271+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-10-26 02:27:44.639302+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-10-26 02:27:44.639331+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-10-26 02:27:44.639363+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-10-26 02:27:44.647608+00:00 [info] <0.222.0> Feature flag `empty_basic_get_metric`: mark as enabled=true
2026-10-26 02:27:44.649419+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-10-26 02:27:44.649482+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-10-26 02:27:44.649511+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-10-26 02:27:44.649545+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2026-10-26 02:27:44.649599+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-10-26 02:27:44.649620+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-10-26 02:27:44.649640+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-10-26 02:27:44.649688+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-10-26 02:27:44.649710+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-10-26 02:27:44.649728+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-10-26 02:27:44.649757+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-10-26 02:27:44.659959+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 0 retries left
2026-10-26 02:27:44.660124+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-10-26 02:27:44.660169+00:00 [info] <0.222.0> Feature flag `implicit_default_bindings`: mark as enabled=true
2026-10-26 02:27:44.662733+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-10-26 02:27:44.662791+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-10-26 02:27:44.662816+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-10-26 02:27:44.662836+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2026-10-26 02:27:44.662876+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2026-10-26 02:27:44.662897+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-10-26 02:27:44.662916+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-10-26 02:27:44.662934+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-10-26 02:27:44.662977+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-10-26 02:27:44.662996+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-10-26 02:27:44.663015+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-10-26 02:27:44.671684+00:00 [info] <0.222.0> Feature flag `stream_queue`: mark as enabled=true
2026-10-26 02:27:44.673632+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-10-26 02:27:44.673710+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-10-26 02:27:44.673739+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-10-26 02:27:44.673773+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2026-10-26 02:27:44.673793+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2026-10-26 02:27:44.673814+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-10-26 02:27:44.673841+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-10-26 02:27:44.673864+00:00 [info] <0.222.0> Feature flags:   [x] stream_queue
2026-10-26 02:27:44.673897+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-10-26 02:27:44.673935+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-10-26 02:27:44.674049+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-10-26 02:27:44.683605+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:27:44.683814+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-10-26 02:27:44.745864+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:27:44.746070+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-10-26 02:27:44.761570+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:27:44.786864+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:27:44.809405+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:27:44.810677+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration.
2026-10-26 02:27:44.810769+00:00 [info] <0.222.0> Will try to unlock with peer discovery backend rabbit_peer_discovery_classic_config
2026-10-26 02:27:44.811349+00:00 [info] <0.222.0> Running boot step database_sync defined by app rabbit
2026-10-26 02:27:44.811462+00:00 [info] <0.222.0> Running boot step feature_flags defined by app rabbit
2026-10-26 02:27:44.811570+00:00 [info] <0.222.0> Running boot step codec_correctness_check defined by app rabbit
2026-10-26 02:27:44.811604+00:00 [info] <0.222.0> Running boot step external_infrastructure defined by app rabbit
2026-10-26 02:27:44.811626+00:00 [info] <0.222.0> Running boot step rabbit_event defined by app rabbit
2026-10-26 02:27:44.811806+00:00 [info] <0.222.0> Running boot step rabbit_registry defined by app rabbit
2026-10-26 02:27:44.811984+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2026-10-26 02:27:44.812128+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2026-10-26 02:27:44.812223+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2026-10-26 02:27:44.812315+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2026-10-26 02:27:44.812405+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2026-10-26 02:27:44.812472+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2026-10-26 02:27:44.812539+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2026-10-26 02:27:44.812586+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2026-10-26 02:27:44.812636+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2026-10-26 02:27:44.812703+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2026-10-26 02:27:44.812763+00:00 [info] <0.222.0> Running boot step rabbit_priority_queue defined by app rabbit
2026-10-26 02:27:44.812798+00:00 [info] <0.222.0> Priority queues enabled, real BQ is rabbit_variable_queue
2026-10-26 02:27:44.812858+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2026-10-26 02:27:44.812950+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2026-10-26 02:27:44.812999+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_random defined by app rabbit
2026-10-26 02:27:44.813044+00:00 [info] <0.222.0> Running boot step kernel_ready defined by app rabbit
2026-10-26 02:27:44.813071+00:00 [info] <0.222.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2026-10-26 02:27:44.813355+00:00 [info] <0.222.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2026-10-26 02:27:44.814176+00:00 [info] <0.521.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2026-10-26 02:27:44.814304+00:00 [info] <0.222.0> Running boot step guid_generator defined by app rabbit
2026-10-26 02:27:44.824768+00:00 [info] <0.222.0> Running boot step rabbit_node_monitor defined by app rabbit
2026-10-26 02:27:44.825754+00:00 [info] <0.525.0> Starting rabbit_node_monitor
2026-10-26 02:27:44.825866+00:00 [info] <0.222.0> Running boot step delegate_sup defined by app rabbit
2026-10-26 02:27:44.826305+00:00 [info] <0.222.0> Running boot step rabbit_memory_monitor defined by app rabbit
2026-10-26 02:27:44.826481+00:00 [info] <0.222.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit
2026-10-26 02:27:44.826544+00:00 [info] <0.222.0> Running boot step core_initialized defined by app rabbit
2026-10-26 02:27:44.826583+00:00 [info] <0.222.0> Running boot step upgrade_queues defined by app rabbit
2026-10-26 02:27:44.834019+00:00 [info] <0.222.0> message_store upgrades: 1 to apply
2026-10-26 02:27:44.834183+00:00 [info] <0.222.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2026-10-26 02:27:44.834358+00:00 [info] <0.222.0> message_store upgrades: No durable queues found. Skipping message store migration
2026-10-26 02:27:44.834407+00:00 [info] <0.222.0> message_store upgrades: Removing the old message store data
2026-10-26 02:27:44.834892+00:00 [info] <0.222.0> message_store upgrades: All upgrades applied successfully
2026-10-26 02:27:44.850100+00:00 [info] <0.222.0> Running boot step channel_tracking defined by app rabbit
2026-10-26 02:27:44.859482+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:27:44.868761+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:27:44.869078+00:00 [info] <0.222.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit
2026-10-26 02:27:44.869182+00:00 [info] <0.222.0> Running boot step connection_tracking defined by app rabbit
2026-10-26 02:27:44.870054+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:27:44.870775+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:27:44.871512+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:27:44.871779+00:00 [info] <0.222.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2026-10-26 02:27:44.871865+00:00 [info] <0.222.0> Running boot step rabbit_definitions_hashing defined by app rabbit
2026-10-26 02:27:44.871932+00:00 [info] <0.222.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2026-10-26 02:27:44.872005+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2026-10-26 02:27:44.872197+00:00 [info] <0.222.0> Running boot step rabbit_policies defined by app rabbit
2026-10-26 02:27:44.872520+00:00 [info] <0.222.0> Running boot step rabbit_policy defined by app rabbit
2026-10-26 02:27:44.872582+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2026-10-26 02:27:44.872636+00:00 [info] <0.222.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit
2026-10-26 02:27:44.872692+00:00 [info] <0.222.0> Running boot step rabbit_stream_coordinator defined by app rabbit
2026-10-26 02:27:44.872787+00:00 [info] <0.222.0> Running boot step rabbit_vhost_limit defined by app rabbit
2026-10-26 02:27:44.872848+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2026-10-26 02:27:44.872892+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2026-10-26 02:27:44.872939+00:00 [warning] <0.222.0> force_fine_statistics set to true; ignored.
2026-10-26 02:27:44.872939+00:00 [warning] <0.222.0> Replaced by {rates_mode, none} in the rabbitmq_management application.
2026-10-26 02:27:44.873001+00:00 [info] <0.222.0> Management plugin: using rates mode 'basic'
2026-10-26 02:27:44.874451+00:00 [info] <0.222.0> Running boot step recovery defined by app rabbit
2026-10-26 02:27:44.875752+00:00 [info] <0.574.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2026-10-26 02:27:44.876601+00:00 [info] <0.574.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048'
2026-10-26 02:27:44.881124+00:00 [info] <0.574.0> Starting message stores for vhost '/'
2026-10-26 02:27:44.881420+00:00 [info] <0.580.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2026-10-26 02:27:44.883231+00:00 [info] <0.574.0> Started message store of type transient for vhost '/'
2026-10-26 02:27:44.883474+00:00 [info] <0.584.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2026-10-26 02:27:44.884082+00:00 [warning] <0.584.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2026-10-26 02:27:44.884853+00:00 [info] <0.574.0> Started message store of type persistent for vhost '/'
2026-10-26 02:27:44.884992+00:00 [info] <0.574.0> Recovering 0 queues of type rabbit_classic_queue took 8ms
2026-10-26 02:27:44.885058+00:00 [info] <0.574.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms
2026-10-26 02:27:44.885089+00:00 [info] <0.574.0> Recovering 0 queues of type rabbit_stream_queue took 0ms
2026-10-26 02:27:44.886302+00:00 [info] <0.222.0> Running boot step empty_db_check defined by app rabbit
2026-10-26 02:27:44.886383+00:00 [info] <0.222.0> Will not seed default virtual host and user: have definitions to load...
2026-10-26 02:27:44.886409+00:00 [info] <0.222.0> Running boot step rabbit_looking_glass defined by app rabbit
2026-10-26 02:27:44.886437+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2026-10-26 02:27:44.886577+00:00 [info] <0.222.0> Running boot step background_gc defined by app rabbit
2026-10-26 02:27:44.886753+00:00 [info] <0.222.0> Running boot step routing_ready defined by app rabbit
2026-10-26 02:27:44.886794+00:00 [info] <0.222.0> Running boot step pre_flight defined by app rabbit
2026-10-26 02:27:44.886815+00:00 [info] <0.222.0> Running boot step notify_cluster defined by app rabbit
2026-10-26 02:27:44.886843+00:00 [info] <0.222.0> Running boot step networking defined by app rabbit
2026-10-26 02:27:44.886877+00:00 [info] <0.222.0> Running boot step definition_import_worker_pool defined by app rabbit
2026-10-26 02:27:44.886918+00:00 [info] <0.280.0> Starting worker pool 'definition_import_pool' with 4 processes in it
2026-10-26 02:27:44.887208+00:00 [info] <0.222.0> Running boot step cluster_name defined by app rabbit
2026-10-26 02:27:44.887248+00:00 [info] <0.222.0> Running boot step direct_client defined by app rabbit
2026-10-26 02:27:44.887319+00:00 [info] <0.222.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit
2026-10-26 02:27:44.887385+00:00 [info] <0.222.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status`
2026-10-26 02:27:44.887512+00:00 [info] <0.525.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-3' up
2026-10-26 02:27:44.888394+00:00 [info] <0.222.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management
2026-10-26 02:27:44.888714+00:00 [info] <0.222.0> Applying definitions from file at '/etc/rabbitmq/definitions.json'
2026-10-26 02:27:44.888773+00:00 [info] <0.222.0> Asked to import definitions. Acting user: rmq-internal
2026-10-26 02:27:44.888854+00:00 [info] <0.222.0> Importing concurrently 1 users...
2026-10-26 02:27:44.945256+00:00 [info] <0.222.0> Importing concurrently 1 vhosts...
2026-10-26 02:27:44.948223+00:00 [info] <0.525.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-1' up
2026-10-26 02:27:44.952782+00:00 [info] <0.222.0> Importing concurrently 1 permissions...
2026-10-26 02:27:44.958783+00:00 [info] <0.608.0> Successfully set permissions for 'guest' in virtual host '/' to '.*', '.*', '.*'
2026-10-26 02:27:44.959067+00:00 [info] <0.222.0> Importing sequentially 1 policies...
2026-10-26 02:27:44.964718+00:00 [info] <0.620.0> Resetting node maintenance status
2026-10-26 02:27:44.984184+00:00 [info] <0.679.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2026-10-26 02:27:44.984410+00:00 [info] <0.707.0> Statistics database started.
2026-10-26 02:27:44.984568+00:00 [info] <0.706.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2026-10-26 02:27:44.999660+00:00 [info] <0.721.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692
2026-10-26 02:27:44.999961+00:00 [info] <0.620.0> Ready to start client connection listeners
2026-10-26 02:27:45.001739+00:00 [info] <0.765.0> started TCP listener on 10.0.0.33:5673
2026-10-26 02:27:45.097689+00:00 [info] <0.620.0> Server startup complete; 4 plugins started.
2026-10-26 02:27:45.097689+00:00 [info] <0.620.0>  * rabbitmq_prometheus
2026-10-26 02:27:45.097689+00:00 [info] <0.620.0>  * rabbitmq_management
2026-10-26 02:27:45.097689+00:00 [info] <0.620.0>  * rabbitmq_web_dispatch
2026-10-26 02:27:45.097689+00:00 [info] <0.620.0>  * rabbitmq_management_agent
2026-10-26 02:28:26.048519+00:00 [info] <0.525.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-3' down
2026-10-26 02:28:26.082485+00:00 [info] <0.525.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-6403-3 listeners: the node is already back
2026-10-26 02:28:26.854768+00:00 [info] <0.1055.0> RabbitMQ is asked to stop...
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0> Stopping RabbitMQ applications and their dependencies in the following order:
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     rabbitmq_management
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     rabbitmq_prometheus
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     rabbitmq_web_dispatch
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     cowboy
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     cowlib
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     rabbitmq_management_agent
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     rabbit
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     amqp_client
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     rabbitmq_prelaunch
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     rabbit_common
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     prometheus
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     ra
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     accept
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     os_mon
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     sysmon_handler
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     osiris
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0>     mnesia
2026-10-26 02:28:26.893667+00:00 [info] <0.1055.0> 
2026-10-26 02:28:26.893859+00:00 [info] <0.1055.0> Stopping application 'rabbitmq_management'
2026-10-26 02:28:26.895503+00:00 [warning] <0.671.0> HTTP listener registry could not find context rabbitmq_management_tls
2026-10-26 02:28:26.897511+00:00 [notice] <0.44.0> Application rabbitmq_management exited with reason: stopped
2026-10-26 02:28:26.897662+00:00 [info] <0.1055.0> Stopping application 'rabbitmq_prometheus'
2026-10-26 02:28:26.899163+00:00 [warning] <0.671.0> HTTP listener registry could not find context rabbitmq_prometheus_tls
2026-10-26 02:28:26.901269+00:00 [notice] <0.44.0> Application rabbitmq_prometheus exited with reason: stopped
2026-10-26 02:28:26.901382+00:00 [info] <0.1055.0> Stopping application 'rabbitmq_web_dispatch'
2026-10-26 02:28:26.903583+00:00 [notice] <0.44.0> Application rabbitmq_web_dispatch exited with reason: stopped
2026-10-26 02:28:26.903703+00:00 [info] <0.1055.0> Stopping application 'cowboy'
2026-10-26 02:28:26.906219+00:00 [notice] <0.44.0> Application cowboy exited with reason: stopped
2026-10-26 02:28:26.906331+00:00 [info] <0.1055.0> Stopping application 'cowlib'
2026-10-26 02:28:26.906379+00:00 [notice] <0.44.0> Application cowlib exited with reason: stopped
2026-10-26 02:28:26.906418+00:00 [info] <0.1055.0> Stopping application 'rabbitmq_management_agent'
2026-10-26 02:28:26.909004+00:00 [notice] <0.44.0> Application rabbitmq_management_agent exited with reason: stopped
2026-10-26 02:28:26.909118+00:00 [info] <0.1055.0> Stopping application 'rabbit'
2026-10-26 02:28:26.909256+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping unregistration.
2026-10-26 02:28:26.909334+00:00 [info] <0.765.0> stopped TCP listener on 10.0.0.33:5673
2026-10-26 02:28:26.910224+00:00 [info] <0.1056.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2' because the vhost is stopping
2026-10-26 02:28:26.910303+00:00 [info] <0.584.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent'
2026-10-26 02:28:26.931592+00:00 [info] <0.584.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped
2026-10-26 02:28:26.931985+00:00 [info] <0.580.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient'
2026-10-26 02:28:26.938391+00:00 [info] <0.580.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped
2026-10-26 02:28:26.939034+00:00 [info] <0.516.0> Management plugin: to stop collect_statistics.
2026-10-26 02:28:31.942345+00:00 [notice] <0.44.0> Application rabbit exited with reason: stopped
2026-10-26 02:28:31.942467+00:00 [info] <0.1055.0> Stopping application 'amqp_client'
2026-10-26 02:28:31.944195+00:00 [notice] <0.44.0> Application amqp_client exited with reason: stopped
2026-10-26 02:28:31.944294+00:00 [info] <0.1055.0> Stopping application 'rabbitmq_prelaunch'
2026-10-26 02:28:31.946132+00:00 [notice] <0.44.0> Application rabbitmq_prelaunch exited with reason: stopped
2026-10-26 02:28:31.946222+00:00 [info] <0.1055.0> Stopping application 'rabbit_common'
2026-10-26 02:28:31.946256+00:00 [notice] <0.44.0> Application rabbit_common exited with reason: stopped
2026-10-26 02:28:31.946289+00:00 [info] <0.1055.0> Stopping application 'prometheus'
2026-10-26 02:28:31.948324+00:00 [notice] <0.44.0> Application prometheus exited with reason: stopped
2026-10-26 02:28:31.948390+00:00 [info] <0.1055.0> Stopping application 'ra'
2026-10-26 02:28:31.951731+00:00 [notice] <0.44.0> Application ra exited with reason: stopped
2026-10-26 02:28:31.951813+00:00 [info] <0.1055.0> Stopping application 'accept'
2026-10-26 02:28:31.951874+00:00 [notice] <0.44.0> Application accept exited with reason: stopped
2026-10-26 02:28:31.951908+00:00 [info] <0.1055.0> Stopping application 'os_mon'
2026-10-26 02:28:31.954158+00:00 [notice] <0.44.0> Application os_mon exited with reason: stopped
2026-10-26 02:28:31.954252+00:00 [info] <0.1055.0> Stopping application 'sysmon_handler'
2026-10-26 02:28:31.956000+00:00 [notice] <0.44.0> Application sysmon_handler exited with reason: stopped
2026-10-26 02:28:31.956101+00:00 [info] <0.1055.0> Stopping application 'osiris'
2026-10-26 02:28:31.958098+00:00 [notice] <0.44.0> Application osiris exited with reason: stopped
2026-10-26 02:28:31.958209+00:00 [info] <0.1055.0> Stopping application 'mnesia'
2026-10-26 02:28:31.968480+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-10-26 02:28:31.968650+00:00 [info] <0.1055.0> Successfully stopped RabbitMQ and its dependencies
2026-10-26 02:28:39.755161+00:00 [info] <0.1126.0> Resetting Rabbit forcefully
2026-10-26 02:28:40.443877+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-10-26 02:28:40.453958+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-10-26 02:28:40.603755+00:00 [info] <0.1141.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:40.603954+00:00 [info] <0.1141.0> Successfully synced tables from a peer
2026-10-26 02:28:40.615770+00:00 [info] <0.1141.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:40.615896+00:00 [info] <0.1141.0> Successfully synced tables from a peer
2026-10-26 02:28:40.615943+00:00 [warning] <0.1141.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2-feature_flags`:
2026-10-26 02:28:40.615992+00:00 [warning] <0.1141.0> Feature flags:   - list of previously disabled feature flags now marked as such: [maintenance_mode_status]
2026-10-26 02:28:40.617610+00:00 [info] <0.1141.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:40.617759+00:00 [info] <0.1141.0> Successfully synced tables from a peer
2026-10-26 02:28:40.635372+00:00 [info] <0.1141.0> Waiting for Mnesia tables for 30000 ms, 0 retries left
2026-10-26 02:28:40.635712+00:00 [info] <0.1141.0> Successfully synced tables from a peer
2026-10-26 02:28:40.642255+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-10-26 02:28:40.661814+00:00 [info] <0.1141.0> Clustering with ['contrail@cn-jenkins-deploy-platform-ansible-os-6403-3',
2026-10-26 02:28:40.661814+00:00 [info] <0.1141.0>                  'contrail@cn-jenkins-deploy-platform-ansible-os-6403-1'] as disc node
2026-10-26 02:28:40.689838+00:00 [info] <0.1141.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:40.690079+00:00 [info] <0.1141.0> Successfully synced tables from a peer
2026-10-26 02:28:41.133641+00:00 [info] <0.1141.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:41.133783+00:00 [info] <0.1141.0> Successfully synced tables from a peer
2026-10-26 02:28:41.133829+00:00 [warning] <0.1141.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2-feature_flags`:
2026-10-26 02:28:41.133880+00:00 [warning] <0.1141.0> Feature flags:   - list of previously enabled feature flags now marked as such: [maintenance_mode_status]
2026-10-26 02:28:41.136597+00:00 [info] <0.1141.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:41.136734+00:00 [info] <0.1141.0> Successfully synced tables from a peer
2026-10-26 02:28:41.155858+00:00 [info] <0.1141.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:41.156027+00:00 [info] <0.1141.0> Successfully synced tables from a peer
2026-10-26 02:28:41.164926+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-10-26 02:28:41.165106+00:00 [error] <0.1141.0> Failed to create a tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': {node_not_running,
2026-10-26 02:28:41.165106+00:00 [error] <0.1141.0>                                                                                                                'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'}
2026-10-26 02:28:41.165313+00:00 [info] <0.1141.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:28:41.166041+00:00 [error] <0.1141.0> Failed to create a per-vhost tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': {node_not_running,
2026-10-26 02:28:41.166041+00:00 [error] <0.1141.0>                                                                                                                          'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'}
2026-10-26 02:28:41.166166+00:00 [info] <0.1141.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:28:41.166459+00:00 [error] <0.1141.0> Failed to create a per-user tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': {node_not_running,
2026-10-26 02:28:41.166459+00:00 [error] <0.1141.0>                                                                                                                         'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'}
2026-10-26 02:28:41.166612+00:00 [info] <0.1141.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0> Halting Erlang VM with the following applications:
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     amqp10_common
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     observer_cli
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     stdout_formatter
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     seshat
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     gen_batch_server
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     aten
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     ranch
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     inets
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     systemd
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     enough
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     cuttlefish
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     credentials_obfuscation
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     recon
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     jsx
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     xmerl
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     tools
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     syntax_tools
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     ssl
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     public_key
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     asn1
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     crypto
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     compiler
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     sasl
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     stdlib
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0>     kernel
2026-10-26 02:28:41.740127+00:00 [info] <0.1495.0> 
2026-10-26 02:28:46.440188+00:00 [notice] <0.222.0> Logging: configured log handlers are now ACTIVE
2026-10-26 02:28:48.463994+00:00 [info] <0.222.0> upgrades: Backing up mnesia dir to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2-upgrade-backup"
2026-10-26 02:28:48.548274+00:00 [info] <0.222.0> upgrades: Mnesia dir backed up to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2-upgrade-backup"
2026-10-26 02:28:48.557516+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-10-26 02:28:48.558855+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-10-26 02:28:48.558910+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-10-26 02:28:48.558956+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-10-26 02:28:48.558977+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2026-10-26 02:28:48.558995+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2026-10-26 02:28:48.559048+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-10-26 02:28:48.559073+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-10-26 02:28:48.559090+00:00 [info] <0.222.0> Feature flags:   [x] stream_queue
2026-10-26 02:28:48.559109+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-10-26 02:28:48.559169+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-10-26 02:28:48.559189+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-10-26 02:28:48.751134+00:00 [info] <0.222.0> ra: starting system quorum_queues
2026-10-26 02:28:48.751247+00:00 [info] <0.222.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/quorum/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2
2026-10-26 02:28:48.752114+00:00 [info] <0.313.0> ra system 'quorum_queues' running pre init for 0 registered servers
2026-10-26 02:28:48.755496+00:00 [info] <0.314.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2026-10-26 02:28:48.755834+00:00 [notice] <0.323.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2026-10-26 02:28:48.809871+00:00 [info] <0.222.0> ra: starting system coordination
2026-10-26 02:28:48.810008+00:00 [info] <0.222.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/coordination/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2
2026-10-26 02:28:48.826632+00:00 [info] <0.331.0> ra system 'coordination' running pre init for 0 registered servers
2026-10-26 02:28:48.829816+00:00 [info] <0.332.0> ra: meta data store initialised for system coordination. 0 record(s) recovered
2026-10-26 02:28:48.830130+00:00 [notice] <0.337.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2026-10-26 02:28:49.000579+00:00 [info] <0.222.0> 
2026-10-26 02:28:49.000579+00:00 [info] <0.222.0>  Starting RabbitMQ 3.10.7 on Erlang 25.0.4 [jit]
2026-10-26 02:28:49.000579+00:00 [info] <0.222.0>  Copyright (c) 2007-2022 VMware, Inc. or its affiliates.
2026-10-26 02:28:49.000579+00:00 [info] <0.222.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0> 
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0>  node           : contrail@cn-jenkins-deploy-platform-ansible-os-6403-2
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0>  home dir       : /var/lib/rabbitmq
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0>  config file(s) : /etc/rabbitmq/rabbitmq.config
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0>                 : /etc/rabbitmq/conf.d/10-defaults.conf
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0>  cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0>  log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0>                 : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2_upgrade.log
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0>                 : <stdout>
2026-10-26 02:28:49.002342+00:00 [info] <0.222.0>  database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2
2026-10-26 02:28:49.343388+00:00 [info] <0.222.0> Feature flag `drop_unroutable_metric`: mark as enabled=true
2026-10-26 02:28:49.344946+00:00 [info] <0.222.0> Feature flag `empty_basic_get_metric`: mark as enabled=true
2026-10-26 02:28:49.570533+00:00 [info] <0.222.0> Running boot step pre_boot defined by app rabbit
2026-10-26 02:28:49.570621+00:00 [info] <0.222.0> Running boot step rabbit_global_counters defined by app rabbit
2026-10-26 02:28:49.570917+00:00 [info] <0.222.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2026-10-26 02:28:49.571011+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics defined by app rabbit
2026-10-26 02:28:49.571699+00:00 [info] <0.222.0> Running boot step rabbit_alarm defined by app rabbit
2026-10-26 02:28:49.594552+00:00 [info] <0.418.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total
2026-10-26 02:28:49.598806+00:00 [info] <0.420.0> Enabling free disk space monitoring
2026-10-26 02:28:49.598888+00:00 [info] <0.420.0> Disk free limit set to 50MB
2026-10-26 02:28:49.601887+00:00 [info] <0.222.0> Running boot step code_server_cache defined by app rabbit
2026-10-26 02:28:49.602173+00:00 [info] <0.222.0> Running boot step file_handle_cache defined by app rabbit
2026-10-26 02:28:49.602428+00:00 [info] <0.425.0> Limiting to approx 927 file handles (832 sockets)
2026-10-26 02:28:49.602554+00:00 [info] <0.426.0> FHC read buffering: OFF
2026-10-26 02:28:49.602593+00:00 [info] <0.426.0> FHC write buffering: ON
2026-10-26 02:28:49.602884+00:00 [info] <0.222.0> Running boot step worker_pool defined by app rabbit
2026-10-26 02:28:49.602938+00:00 [info] <0.350.0> Will use 4 processes for default worker pool
2026-10-26 02:28:49.602977+00:00 [info] <0.350.0> Starting worker pool 'worker_pool' with 4 processes in it
2026-10-26 02:28:49.603258+00:00 [info] <0.222.0> Running boot step database defined by app rabbit
2026-10-26 02:28:49.605885+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:49.613462+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-10-26 02:28:49.614249+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:49.614357+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-10-26 02:28:49.614409+00:00 [warning] <0.222.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2-feature_flags`:
2026-10-26 02:28:49.614448+00:00 [warning] <0.222.0> Feature flags:   - list of previously disabled feature flags now marked as such: [empty_basic_get_metric]
2026-10-26 02:28:49.617519+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:49.617633+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-10-26 02:28:49.639642+00:00 [info] <0.222.0> upgrades: Mnesia backup removed
2026-10-26 02:28:49.639719+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-10-26 02:28:49.639925+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-10-26 02:28:49.639953+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration.
2026-10-26 02:28:49.640106+00:00 [info] <0.222.0> Running boot step database_sync defined by app rabbit
2026-10-26 02:28:49.640252+00:00 [info] <0.222.0> Running boot step feature_flags defined by app rabbit
2026-10-26 02:28:49.640385+00:00 [info] <0.222.0> Running boot step codec_correctness_check defined by app rabbit
2026-10-26 02:28:49.640419+00:00 [info] <0.222.0> Running boot step external_infrastructure defined by app rabbit
2026-10-26 02:28:49.640439+00:00 [info] <0.222.0> Running boot step rabbit_event defined by app rabbit
2026-10-26 02:28:49.640592+00:00 [info] <0.222.0> Running boot step rabbit_registry defined by app rabbit
2026-10-26 02:28:49.640640+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2026-10-26 02:28:49.640690+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2026-10-26 02:28:49.640729+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2026-10-26 02:28:49.640762+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2026-10-26 02:28:49.640800+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2026-10-26 02:28:49.640840+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2026-10-26 02:28:49.640940+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2026-10-26 02:28:49.641059+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2026-10-26 02:28:49.641251+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2026-10-26 02:28:49.641318+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2026-10-26 02:28:49.641372+00:00 [info] <0.222.0> Running boot step rabbit_priority_queue defined by app rabbit
2026-10-26 02:28:49.641403+00:00 [info] <0.222.0> Priority queues enabled, real BQ is rabbit_variable_queue
2026-10-26 02:28:49.641450+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2026-10-26 02:28:49.641496+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2026-10-26 02:28:49.641531+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_random defined by app rabbit
2026-10-26 02:28:49.641567+00:00 [info] <0.222.0> Running boot step kernel_ready defined by app rabbit
2026-10-26 02:28:49.641587+00:00 [info] <0.222.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2026-10-26 02:28:49.641681+00:00 [info] <0.222.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2026-10-26 02:28:49.642642+00:00 [info] <0.450.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2026-10-26 02:28:49.642749+00:00 [info] <0.222.0> Running boot step guid_generator defined by app rabbit
2026-10-26 02:28:49.654880+00:00 [info] <0.222.0> Running boot step rabbit_node_monitor defined by app rabbit
2026-10-26 02:28:49.655833+00:00 [info] <0.454.0> Starting rabbit_node_monitor
2026-10-26 02:28:49.655974+00:00 [info] <0.222.0> Running boot step delegate_sup defined by app rabbit
2026-10-26 02:28:49.656372+00:00 [info] <0.222.0> Running boot step rabbit_memory_monitor defined by app rabbit
2026-10-26 02:28:49.656547+00:00 [info] <0.222.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit
2026-10-26 02:28:49.656634+00:00 [info] <0.222.0> Running boot step core_initialized defined by app rabbit
2026-10-26 02:28:49.656660+00:00 [info] <0.222.0> Running boot step upgrade_queues defined by app rabbit
2026-10-26 02:28:49.664646+00:00 [info] <0.222.0> message_store upgrades: 1 to apply
2026-10-26 02:28:49.664817+00:00 [info] <0.222.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2026-10-26 02:28:49.665021+00:00 [info] <0.222.0> message_store upgrades: No durable queues found. Skipping message store migration
2026-10-26 02:28:49.665052+00:00 [info] <0.222.0> message_store upgrades: Removing the old message store data
2026-10-26 02:28:49.665445+00:00 [info] <0.222.0> message_store upgrades: All upgrades applied successfully
2026-10-26 02:28:49.676431+00:00 [info] <0.222.0> Running boot step channel_tracking defined by app rabbit
2026-10-26 02:28:49.684608+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:28:49.723209+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:28:49.723519+00:00 [info] <0.222.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit
2026-10-26 02:28:49.723589+00:00 [info] <0.222.0> Running boot step connection_tracking defined by app rabbit
2026-10-26 02:28:49.828097+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:28:49.902353+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:28:49.915590+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-6403-2'
2026-10-26 02:28:49.915944+00:00 [info] <0.222.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2026-10-26 02:28:49.916016+00:00 [info] <0.222.0> Running boot step rabbit_definitions_hashing defined by app rabbit
2026-10-26 02:28:49.916103+00:00 [info] <0.222.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2026-10-26 02:28:49.916206+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2026-10-26 02:28:49.916413+00:00 [info] <0.222.0> Running boot step rabbit_policies defined by app rabbit
2026-10-26 02:28:49.916725+00:00 [info] <0.222.0> Running boot step rabbit_policy defined by app rabbit
2026-10-26 02:28:49.916799+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2026-10-26 02:28:49.916866+00:00 [info] <0.222.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit
2026-10-26 02:28:49.916901+00:00 [info] <0.222.0> Running boot step rabbit_stream_coordinator defined by app rabbit
2026-10-26 02:28:49.917030+00:00 [info] <0.222.0> Running boot step rabbit_vhost_limit defined by app rabbit
2026-10-26 02:28:49.917148+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2026-10-26 02:28:49.917216+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2026-10-26 02:28:49.917260+00:00 [warning] <0.222.0> force_fine_statistics set to true; ignored.
2026-10-26 02:28:49.917260+00:00 [warning] <0.222.0> Replaced by {rates_mode, none} in the rabbitmq_management application.
2026-10-26 02:28:49.917323+00:00 [info] <0.222.0> Management plugin: using rates mode 'basic'
2026-10-26 02:28:49.919691+00:00 [info] <0.222.0> Running boot step recovery defined by app rabbit
2026-10-26 02:28:49.921235+00:00 [info] <0.512.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-6403-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2026-10-26 02:28:49.922826+00:00 [info] <0.512.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048'
2026-10-26 02:28:49.926784+00:00 [info] <0.512.0> Starting message stores for vhost '/'
2026-10-26 02:28:49.927050+00:00 [info] <0.517.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2026-10-26 02:28:49.944046+00:00 [info] <0.512.0> Started message store of type transient for vhost '/'
2026-10-26 02:28:49.944438+00:00 [info] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2026-10-26 02:28:49.945291+00:00 [warning] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2026-10-26 02:28:49.946283+00:00 [info] <0.512.0> Started message store of type persistent for vhost '/'
2026-10-26 02:28:49.946478+00:00 [info] <0.512.0> Recovering 0 queues of type rabbit_classic_queue took 23ms
2026-10-26 02:28:49.946548+00:00 [info] <0.512.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms
2026-10-26 02:28:49.946595+00:00 [info] <0.512.0> Recovering 0 queues of type rabbit_stream_queue took 0ms
2026-10-26 02:28:49.948089+00:00 [info] <0.512.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.541.0>
2026-10-26 02:28:49.948498+00:00 [info] <0.512.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-6403-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.545.0>
2026-10-26 02:28:49.948789+00:00 [info] <0.512.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-6403-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.549.0>
2026-10-26 02:28:49.949024+00:00 [info] <0.512.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.553.0>
2026-10-26 02:28:49.949310+00:00 [info] <0.512.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-6403-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.557.0>
2026-10-26 02:28:49.949615+00:00 [info] <0.512.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-6403-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.561.0>
2026-10-26 02:28:49.949915+00:00 [info] <0.512.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-6403-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.565.0>
2026-10-26 02:28:49.950359+00:00 [info] <0.512.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-6403-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.569.0>
2026-10-26 02:28:49.950612+00:00 [info] <0.512.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.573.0>
2026-10-26 02:28:49.951013+00:00 [info] <0.512.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-6403-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.577.0>
2026-10-26 02:28:49.951761+00:00 [info] <0.512.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-6403-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.585.0>
2026-10-26 02:28:49.952096+00:00 [info] <0.512.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-6403-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.589.0>
2026-10-26 02:28:49.952623+00:00 [info] <0.512.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-6403-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-2': <0.593.0>
2026-10-26 02:28:49.952783+00:00 [info] <0.222.0> Running boot step empty_db_check defined by app rabbit
2026-10-26 02:28:49.952892+00:00 [info] <0.222.0> Will not seed default virtual host and user: have definitions to load...
2026-10-26 02:28:49.952925+00:00 [info] <0.222.0> Running boot step rabbit_looking_glass defined by app rabbit
2026-10-26 02:28:49.952987+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2026-10-26 02:28:49.953238+00:00 [info] <0.222.0> Running boot step background_gc defined by app rabbit
2026-10-26 02:28:49.953418+00:00 [info] <0.222.0> Running boot step routing_ready defined by app rabbit
2026-10-26 02:28:49.953483+00:00 [info] <0.222.0> Running boot step pre_flight defined by app rabbit
2026-10-26 02:28:49.953510+00:00 [info] <0.222.0> Running boot step notify_cluster defined by app rabbit
2026-10-26 02:28:49.953572+00:00 [info] <0.222.0> Running boot step networking defined by app rabbit
2026-10-26 02:28:49.953609+00:00 [info] <0.222.0> Running boot step definition_import_worker_pool defined by app rabbit
2026-10-26 02:28:49.953669+00:00 [info] <0.350.0> Starting worker pool 'definition_import_pool' with 4 processes in it
2026-10-26 02:28:49.954648+00:00 [info] <0.222.0> Running boot step cluster_name defined by app rabbit
2026-10-26 02:28:49.954707+00:00 [info] <0.222.0> Running boot step direct_client defined by app rabbit
2026-10-26 02:28:49.954894+00:00 [info] <0.222.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit
2026-10-26 02:28:49.954945+00:00 [info] <0.222.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status`
2026-10-26 02:28:49.954994+00:00 [info] <0.454.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-1' up
2026-10-26 02:28:49.956057+00:00 [info] <0.222.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management
2026-10-26 02:28:49.956751+00:00 [info] <0.222.0> Applying definitions from file at '/etc/rabbitmq/definitions.json'
2026-10-26 02:28:49.956803+00:00 [info] <0.222.0> Asked to import definitions. Acting user: rmq-internal
2026-10-26 02:28:49.956889+00:00 [info] <0.222.0> Importing concurrently 1 users...
2026-10-26 02:28:49.972937+00:00 [info] <0.222.0> Importing concurrently 1 vhosts...
2026-10-26 02:28:49.985171+00:00 [info] <0.222.0> Importing concurrently 1 permissions...
2026-10-26 02:28:49.992768+00:00 [info] <0.604.0> Successfully set permissions for 'guest' in virtual host '/' to '.*', '.*', '.*'
2026-10-26 02:28:49.992959+00:00 [info] <0.222.0> Importing sequentially 1 policies...
2026-10-26 02:28:49.994162+00:00 [info] <0.454.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-3' up
2026-10-26 02:28:49.999801+00:00 [info] <0.686.0> Resetting node maintenance status
2026-10-26 02:28:50.032250+00:00 [info] <0.746.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2026-10-26 02:28:50.032434+00:00 [info] <0.774.0> Statistics database started.
2026-10-26 02:28:50.032523+00:00 [info] <0.773.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2026-10-26 02:28:50.045007+00:00 [info] <0.788.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692
2026-10-26 02:28:50.045270+00:00 [info] <0.686.0> Ready to start client connection listeners
2026-10-26 02:28:50.046873+00:00 [info] <0.832.0> started TCP listener on 10.0.0.33:5673
2026-10-26 02:28:50.178679+00:00 [info] <0.686.0> Server startup complete; 4 plugins started.
2026-10-26 02:28:50.178679+00:00 [info] <0.686.0>  * rabbitmq_prometheus
2026-10-26 02:28:50.178679+00:00 [info] <0.686.0>  * rabbitmq_management
2026-10-26 02:28:50.178679+00:00 [info] <0.686.0>  * rabbitmq_web_dispatch
2026-10-26 02:28:50.178679+00:00 [info] <0.686.0>  * rabbitmq_management_agent
2026-10-26 02:29:31.661824+00:00 [info] <0.541.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Secondary replica of queue <contrail@cn-jenkins-deploy-platform-ansible-os-6403-2.1792981652.541.0> detected replica  <contrail@cn-jenkins-deploy-platform-ansible-os-6403-3.1792981652.496.0> to be down
2026-10-26 02:29:31.662905+00:00 [info] <0.589.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-6403-3..dummy' in vhost '/': Secondary replica of queue <contrail@cn-jenkins-deploy-platform-ansible-os-6403-2.1792981652.589.0> detected replica  <contrail@cn-jenkins-deploy-platform-ansible-os-6403-3.1792981652.974.0> to be down
2026-10-26 02:29:31.662938+00:00 [info] <0.997.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-6403-3' in vhost '/': Secondary replica of queue <contrail@cn-jenkins-deploy-platform-ansible-os-6403-2.1792981652.997.0> detected replica  <contrail@cn-jenkins-deploy-platform-ansible-os-6403-3.1792981652.1215.0> to be down
2026-10-26 02:29:31.664692+00:00 [info] <0.545.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-6403-2.' in vhost '/': Secondary replica of queue <contrail@cn-jenkins-deploy-platform-ansible-os-6403-2.1792981652.545.0> detected replica  <contrail@cn-jenkins-deploy-platform-ansible-os-6403-3.1792981652.500.0> to be down
2026-10-26 02:29:31.665002+00:00 [info] <0.1054.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-6403-2' in vhost '/': Secondary replica of queue <contrail@cn-jenkins-deploy-platform-ansible-os-6403-2.1792981652.1054.0> detected replica  <contrail@cn-jenkins-deploy-platform-ansible-os-6403-3.1792981652.1266.0> to be down
2026-10-26 02:29:31.666056+00:00 [info] <0.553.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Secondary replica of queue <contrail@cn-jenkins-deploy-platform-ansible-os-6403-2.1792981652.553.0> detected replica  <contrail@cn-jenkins-deploy-platform-ansible-os-6403-3.1792981652.508.0> to be down
2026-10-26 02:29:31.668014+00:00 [info] <0.561.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-6403-2..dummy' in vhost '/': Secondary replica of queue <contrail@cn-jenkins-deploy-platform-ansible-os-6403-2.1792981652.561.0> detected replica  <contrail@cn-jenkins-deploy-platform-ansible-os-6403-3.1792981652.512.0> to be down
2026-10-26 02:29:31.670621+00:00 [info] <0.969.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-6403-1' in vhost '/': Secondary replica of queue <contrail@cn-jenkins-deploy-platform-ansible-os-6403-2.1792981652.969.0> detected replica  <contrail@cn-jenkins-deploy-platform-ansible-os-6403-3.1792981652.1190.0> to be down
2026-10-26 02:29:36.570893+00:00 [info] <0.454.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-3' down
2026-10-26 02:29:36.594072+00:00 [info] <0.454.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-6403-3 listeners: the node is already back
2026-10-26 02:29:44.653108+00:00 [info] <0.454.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-3' down: connection_closed
2026-10-26 02:29:45.786471+00:00 [info] <0.454.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-3' up
2026-10-26 02:29:47.264553+00:00 [info] <0.454.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-3' down: connection_closed
2026-10-26 02:29:52.895868+00:00 [info] <0.454.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-3' up
2026-10-26 02:29:53.486235+00:00 [info] <0.454.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-6403-3' up