2025-03-20 00:44:22.399 [info] <0.8.0> Log file opened with Lager
2025-03-20 00:44:25.109 [info] <0.8.0> Feature flags: list of feature flags found:
2025-03-20 00:44:25.109 [info] <0.8.0> Feature flags: feature flag states written to disk: yes
2025-03-20 00:44:25.140 [info] <0.240.0> 
 Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21
 Copyright (c) 2007-2020 Pivotal Software, Inc.
 Licensed under the MPL.  See https://www.rabbitmq.com/
2025-03-20 00:44:25.140 [info] <0.240.0> 
 node           : contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
 home dir       : /var/lib/rabbitmq
 config file(s) : /etc/rabbitmq/rabbitmq.config
 cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
 log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
                : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2_upgrade.log
 database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
2025-03-20 00:44:25.153 [info] <0.240.0> Running boot step pre_boot defined by app rabbit
2025-03-20 00:44:25.153 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-03-20 00:44:25.153 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit
2025-03-20 00:44:25.158 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total
2025-03-20 00:44:25.165 [info] <0.248.0> Enabling free disk space monitoring
2025-03-20 00:44:25.165 [info] <0.248.0> Disk free limit set to 50MB
2025-03-20 00:44:25.172 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit
2025-03-20 00:44:25.172 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit
2025-03-20 00:44:25.172 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets)
2025-03-20 00:44:25.172 [info] <0.252.0> FHC read buffering:  OFF
2025-03-20 00:44:25.172 [info] <0.252.0> FHC write buffering: ON
2025-03-20 00:44:25.172 [info] <0.240.0> Running boot step worker_pool defined by app rabbit
2025-03-20 00:44:25.173 [info] <0.241.0> Will use 4 processes for default worker pool
2025-03-20 00:44:25.173 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it
2025-03-20 00:44:25.173 [info] <0.240.0> Running boot step database defined by app rabbit
2025-03-20 00:44:25.173 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2 is empty. Assuming we need to join an existing cluster or initialise from scratch...
2025-03-20 00:44:25.173 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config
2025-03-20 00:44:25.173 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 00:44:25.173 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay
2025-03-20 00:44:25.173 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration.
2025-03-20 00:44:25.173 [info] <0.240.0> Will wait for 32299 milliseconds before proceeding with registration...
2025-03-20 00:44:57.473 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-2923-1, contrail@cn-jenkins-deploy-platform-ansible-os-2923-2, contrail@cn-jenkins-deploy-platform-ansible-os-2923-3
2025-03-20 00:44:57.473 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-2923-1, contrail@cn-jenkins-deploy-platform-ansible-os-2923-3
2025-03-20 00:44:57.474 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-1: {error,tables_not_present}
2025-03-20 00:44:57.475 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-3: {error,tables_not_present}
2025-03-20 00:44:57.475 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left...
2025-03-20 00:44:57.977 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-1: {error,tables_not_present}
2025-03-20 00:44:57.978 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-3: {error,tables_not_present}
2025-03-20 00:44:57.978 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left...
2025-03-20 00:44:58.480 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-1: {error,tables_not_present}
2025-03-20 00:44:58.481 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-3: {error,tables_not_present}
2025-03-20 00:44:58.481 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left...
2025-03-20 00:44:58.983 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-1: {error,tables_not_present}
2025-03-20 00:44:58.984 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-3: {error,tables_not_present}
2025-03-20 00:44:58.984 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left...
2025-03-20 00:44:59.488 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-1: {error,tables_not_present}
2025-03-20 00:44:59.489 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-3: {error,tables_not_present}
2025-03-20 00:44:59.489 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left...
2025-03-20 00:44:59.991 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-1: {error,tables_not_present}
2025-03-20 00:44:59.992 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-3: {error,tables_not_present}
2025-03-20 00:44:59.992 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left...
2025-03-20 00:45:00.494 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-1: {error,tables_not_present}
2025-03-20 00:45:00.495 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-3: {error,tables_not_present}
2025-03-20 00:45:00.495 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left...
2025-03-20 00:45:00.997 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-1: {error,tables_not_present}
2025-03-20 00:45:00.998 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-3: {error,tables_not_present}
2025-03-20 00:45:00.998 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left...
2025-03-20 00:45:01.500 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-1: {error,tables_not_present}
2025-03-20 00:45:01.501 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2923-3: {error,tables_not_present}
2025-03-20 00:45:01.502 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left...
2025-03-20 00:45:02.008 [info] <0.240.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' selected for auto-clustering
2025-03-20 00:45:02.041 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 00:45:02.041 [info] <0.240.0> Successfully synced tables from a peer
2025-03-20 00:45:02.666 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 00:45:02.666 [info] <0.240.0> Successfully synced tables from a peer
2025-03-20 00:45:02.705 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 00:45:02.705 [info] <0.240.0> Successfully synced tables from a peer
2025-03-20 00:45:02.721 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 00:45:02.727 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 00:45:02.728 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 00:45:02.728 [info] <0.240.0> Running boot step database_sync defined by app rabbit
2025-03-20 00:45:02.728 [info] <0.240.0> Running boot step feature_flags defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2025-03-20 00:45:02.729 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2025-03-20 00:45:02.730 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2025-03-20 00:45:02.733 [info] <0.480.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2025-03-20 00:45:02.733 [info] <0.240.0> Running boot step guid_generator defined by app rabbit
2025-03-20 00:45:02.739 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit
2025-03-20 00:45:02.741 [info] <0.484.0> Starting rabbit_node_monitor
2025-03-20 00:45:02.741 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit
2025-03-20 00:45:02.741 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit
2025-03-20 00:45:02.742 [info] <0.240.0> Running boot step core_initialized defined by app rabbit
2025-03-20 00:45:02.742 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit
2025-03-20 00:45:02.774 [info] <0.240.0> message_store upgrades: 1 to apply
2025-03-20 00:45:02.774 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2025-03-20 00:45:02.774 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration
2025-03-20 00:45:02.774 [info] <0.240.0> message_store upgrades: Removing the old message store data
2025-03-20 00:45:02.774 [info] <0.240.0> message_store upgrades: All upgrades applied successfully
2025-03-20 00:45:02.809 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit
2025-03-20 00:45:02.809 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2025-03-20 00:45:02.809 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2025-03-20 00:45:02.809 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2025-03-20 00:45:02.809 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit
2025-03-20 00:45:02.810 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit
2025-03-20 00:45:02.810 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2025-03-20 00:45:02.810 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit
2025-03-20 00:45:02.810 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2025-03-20 00:45:02.810 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2025-03-20 00:45:02.810 [warning] <0.240.0> force_fine_statistics set to true; ignored.
Replaced by {rates_mode, none} in the rabbitmq_management application.
2025-03-20 00:45:02.810 [info] <0.240.0> Management plugin: using rates mode 'basic'
2025-03-20 00:45:02.812 [info] <0.240.0> Running boot step recovery defined by app rabbit
2025-03-20 00:45:02.812 [info] <0.521.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2025-03-20 00:45:02.820 [info] <0.521.0> Starting message stores for vhost '/'
2025-03-20 00:45:02.820 [info] <0.525.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2025-03-20 00:45:02.821 [info] <0.521.0> Started message store of type transient for vhost '/'
2025-03-20 00:45:02.821 [info] <0.528.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2025-03-20 00:45:02.823 [warning] <0.528.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2025-03-20 00:45:02.824 [info] <0.521.0> Started message store of type persistent for vhost '/'
2025-03-20 00:45:02.825 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management
2025-03-20 00:45:02.825 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json
2025-03-20 00:45:02.825 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal
2025-03-20 00:45:02.826 [info] <0.240.0> Importing users...
2025-03-20 00:45:02.840 [info] <0.240.0> Setting user tags for user 'guest' to [administrator]
2025-03-20 00:45:02.845 [info] <0.240.0> Importing vhosts...
2025-03-20 00:45:02.846 [info] <0.240.0> Importing user permissions...
2025-03-20 00:45:02.846 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*'
2025-03-20 00:45:02.851 [info] <0.240.0> Importing topic permissions...
2025-03-20 00:45:02.851 [info] <0.240.0> Importing parameters...
2025-03-20 00:45:02.851 [info] <0.240.0> Importing global parameters...
2025-03-20 00:45:02.852 [info] <0.240.0> Importing policies...
2025-03-20 00:45:02.857 [info] <0.240.0> Importing queues...
2025-03-20 00:45:02.857 [info] <0.240.0> Importing exchanges...
2025-03-20 00:45:02.857 [info] <0.240.0> Importing bindings...
2025-03-20 00:45:02.857 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit
2025-03-20 00:45:02.857 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit
2025-03-20 00:45:02.857 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2025-03-20 00:45:02.857 [info] <0.240.0> Running boot step background_gc defined by app rabbit
2025-03-20 00:45:02.857 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit
2025-03-20 00:45:02.858 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 00:45:02.859 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 00:45:02.860 [info] <0.240.0> Running boot step routing_ready defined by app rabbit
2025-03-20 00:45:02.860 [info] <0.240.0> Running boot step pre_flight defined by app rabbit
2025-03-20 00:45:02.860 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit
2025-03-20 00:45:02.860 [info] <0.240.0> Running boot step networking defined by app rabbit
2025-03-20 00:45:02.860 [info] <0.484.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' up
2025-03-20 00:45:02.863 [info] <0.569.0> started TCP listener on [::]:5673
2025-03-20 00:45:02.863 [info] <0.240.0> Running boot step cluster_name defined by app rabbit
2025-03-20 00:45:02.863 [info] <0.240.0> Running boot step direct_client defined by app rabbit
2025-03-20 00:45:02.863 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit
2025-03-20 00:45:02.863 [info] <0.571.0> Swapping OS signal event handler (erl_signal_server) for our own
2025-03-20 00:45:02.904 [info] <0.622.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2025-03-20 00:45:02.904 [info] <0.728.0> Statistics database started.
2025-03-20 00:45:02.904 [info] <0.727.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2025-03-20 00:45:02.904 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50
2025-03-20 00:45:03.067 [info] <0.742.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping...
2025-03-20 00:45:03.070 [info] <0.8.0> Server startup complete; 3 plugins started.
 * rabbitmq_management
 * rabbitmq_web_dispatch
 * rabbitmq_management_agent
2025-03-20 00:45:03.168 [info] <0.742.0> RabbitMQ is asked to stop...
2025-03-20 00:45:03.208 [info] <0.742.0> Stopping RabbitMQ applications and their dependencies in the following order:
    rabbitmq_management
    amqp_client
    rabbitmq_web_dispatch
    cowboy
    cowlib
    rabbitmq_management_agent
    rabbit
    mnesia
    rabbit_common
    sysmon_handler
    os_mon
2025-03-20 00:45:03.208 [info] <0.742.0> Stopping application 'rabbitmq_management'
2025-03-20 00:45:03.209 [warning] <0.618.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls
2025-03-20 00:45:03.211 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped
2025-03-20 00:45:03.211 [info] <0.742.0> Stopping application 'amqp_client'
2025-03-20 00:45:03.212 [info] <0.43.0> Application amqp_client exited with reason: stopped
2025-03-20 00:45:03.212 [info] <0.742.0> Stopping application 'rabbitmq_web_dispatch'
2025-03-20 00:45:03.213 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped
2025-03-20 00:45:03.213 [info] <0.742.0> Stopping application 'cowboy'
2025-03-20 00:45:03.214 [info] <0.742.0> Stopping application 'cowlib'
2025-03-20 00:45:03.214 [info] <0.43.0> Application cowboy exited with reason: stopped
2025-03-20 00:45:03.214 [info] <0.43.0> Application cowlib exited with reason: stopped
2025-03-20 00:45:03.214 [info] <0.742.0> Stopping application 'rabbitmq_management_agent'
2025-03-20 00:45:03.216 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped
2025-03-20 00:45:03.216 [info] <0.742.0> Stopping application 'rabbit'
2025-03-20 00:45:03.216 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 00:45:03.216 [info] <0.569.0> stopped TCP listener on [::]:5673
2025-03-20 00:45:03.217 [info] <0.509.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2' because the vhost is stopping
2025-03-20 00:45:03.217 [info] <0.528.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent'
2025-03-20 00:45:03.222 [info] <0.528.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped
2025-03-20 00:45:03.222 [info] <0.525.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient'
2025-03-20 00:45:03.227 [info] <0.525.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped
2025-03-20 00:45:03.230 [info] <0.43.0> Application rabbit exited with reason: stopped
2025-03-20 00:45:03.230 [info] <0.742.0> Stopping application 'mnesia'
2025-03-20 00:45:03.233 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 00:45:03.234 [info] <0.742.0> Stopping application 'rabbit_common'
2025-03-20 00:45:03.234 [info] <0.43.0> Application rabbit_common exited with reason: stopped
2025-03-20 00:45:03.234 [info] <0.742.0> Stopping application 'sysmon_handler'
2025-03-20 00:45:03.236 [info] <0.43.0> Application sysmon_handler exited with reason: stopped
2025-03-20 00:45:03.236 [info] <0.742.0> Stopping application 'os_mon'
2025-03-20 00:45:03.238 [info] <0.43.0> Application os_mon exited with reason: stopped
2025-03-20 00:45:03.238 [info] <0.742.0> Successfully stopped RabbitMQ and its dependencies
2025-03-20 00:45:03.238 [info] <0.742.0> Halting Erlang VM with the following applications:
    ranch
    ssl
    credentials_obfuscation
    public_key
    asn1
    observer_cli
    jsx
    tools
    crypto
    stdout_formatter
    recon
    inets
    xmerl
    lager
    goldrush
    compiler
    syntax_tools
    sasl
    stdlib
    kernel
2025-03-20 00:45:08.415 [info] <0.8.0> Log file opened with Lager
2025-03-20 00:45:09.949 [info] <0.8.0> Feature flags: list of feature flags found:
2025-03-20 00:45:09.949 [info] <0.8.0> Feature flags: feature flag states written to disk: yes
2025-03-20 00:45:10.046 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 00:45:10.100 [info] <0.310.0> 
 Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21
 Copyright (c) 2007-2020 Pivotal Software, Inc.
 Licensed under the MPL.  See https://www.rabbitmq.com/
2025-03-20 00:45:10.101 [info] <0.310.0> 
 node           : contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
 home dir       : /var/lib/rabbitmq
 config file(s) : /etc/rabbitmq/rabbitmq.config
 cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
 log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
                : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2_upgrade.log
 database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
2025-03-20 00:45:10.113 [info] <0.310.0> Running boot step pre_boot defined by app rabbit
2025-03-20 00:45:10.113 [info] <0.310.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-03-20 00:45:10.114 [info] <0.310.0> Running boot step rabbit_alarm defined by app rabbit
2025-03-20 00:45:10.119 [info] <0.319.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total
2025-03-20 00:45:10.125 [info] <0.329.0> Enabling free disk space monitoring
2025-03-20 00:45:10.125 [info] <0.329.0> Disk free limit set to 50MB
2025-03-20 00:45:10.132 [info] <0.310.0> Running boot step code_server_cache defined by app rabbit
2025-03-20 00:45:10.132 [info] <0.310.0> Running boot step file_handle_cache defined by app rabbit
2025-03-20 00:45:10.133 [info] <0.358.0> FHC read buffering:  OFF
2025-03-20 00:45:10.133 [info] <0.358.0> FHC write buffering: ON
2025-03-20 00:45:10.133 [info] <0.357.0> Limiting to approx 65436 file handles (58890 sockets)
2025-03-20 00:45:10.133 [info] <0.310.0> Running boot step worker_pool defined by app rabbit
2025-03-20 00:45:10.133 [info] <0.311.0> Will use 4 processes for default worker pool
2025-03-20 00:45:10.133 [info] <0.311.0> Starting worker pool 'worker_pool' with 4 processes in it
2025-03-20 00:45:10.133 [info] <0.310.0> Running boot step database defined by app rabbit
2025-03-20 00:45:10.142 [info] <0.310.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 00:45:10.160 [info] <0.310.0> Successfully synced tables from a peer
2025-03-20 00:45:10.161 [info] <0.310.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 00:45:10.161 [info] <0.310.0> Successfully synced tables from a peer
2025-03-20 00:45:10.189 [info] <0.310.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 00:45:10.190 [info] <0.310.0> Successfully synced tables from a peer
2025-03-20 00:45:10.190 [info] <0.310.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 00:45:10.258 [info] <0.310.0> Running boot step database_sync defined by app rabbit
2025-03-20 00:45:10.258 [info] <0.310.0> Running boot step feature_flags defined by app rabbit
2025-03-20 00:45:10.258 [info] <0.310.0> Running boot step codec_correctness_check defined by app rabbit
2025-03-20 00:45:10.258 [info] <0.310.0> Running boot step external_infrastructure defined by app rabbit
2025-03-20 00:45:10.258 [info] <0.310.0> Running boot step rabbit_registry defined by app rabbit
2025-03-20 00:45:10.258 [info] <0.310.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2025-03-20 00:45:10.258 [info] <0.310.0> Running boot step rabbit_queue_location_random defined by app rabbit
2025-03-20 00:45:10.259 [info] <0.310.0> Running boot step rabbit_event defined by app rabbit
2025-03-20 00:45:10.259 [info] <0.310.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2025-03-20 00:45:10.259 [info] <0.310.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2025-03-20 00:45:10.259 [info] <0.310.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2025-03-20 00:45:10.259 [info] <0.310.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2025-03-20 00:45:10.259 [info] <0.310.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2025-03-20 00:45:10.259 [info] <0.310.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2025-03-20 00:45:10.260 [info] <0.310.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2025-03-20 00:45:10.260 [info] <0.310.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2025-03-20 00:45:10.260 [info] <0.310.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2025-03-20 00:45:10.260 [info] <0.310.0> Running boot step rabbit_priority_queue defined by app rabbit
2025-03-20 00:45:10.260 [info] <0.310.0> Priority queues enabled, real BQ is rabbit_variable_queue
2025-03-20 00:45:10.260 [info] <0.310.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2025-03-20 00:45:10.260 [info] <0.310.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2025-03-20 00:45:10.260 [info] <0.310.0> Running boot step kernel_ready defined by app rabbit
2025-03-20 00:45:10.260 [info] <0.310.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2025-03-20 00:45:10.261 [info] <0.310.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2025-03-20 00:45:10.261 [info] <0.414.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2025-03-20 00:45:10.261 [info] <0.310.0> Running boot step guid_generator defined by app rabbit
2025-03-20 00:45:10.266 [info] <0.310.0> Running boot step rabbit_node_monitor defined by app rabbit
2025-03-20 00:45:10.267 [info] <0.418.0> Starting rabbit_node_monitor
2025-03-20 00:45:10.267 [info] <0.310.0> Running boot step delegate_sup defined by app rabbit
2025-03-20 00:45:10.267 [info] <0.310.0> Running boot step rabbit_memory_monitor defined by app rabbit
2025-03-20 00:45:10.268 [info] <0.310.0> Running boot step core_initialized defined by app rabbit
2025-03-20 00:45:10.268 [info] <0.310.0> Running boot step upgrade_queues defined by app rabbit
2025-03-20 00:45:10.291 [info] <0.310.0> Running boot step rabbit_connection_tracking defined by app rabbit
2025-03-20 00:45:10.291 [info] <0.310.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2025-03-20 00:45:10.291 [info] <0.310.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2025-03-20 00:45:10.291 [info] <0.310.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2025-03-20 00:45:10.292 [info] <0.310.0> Running boot step rabbit_policies defined by app rabbit
2025-03-20 00:45:10.292 [info] <0.310.0> Running boot step rabbit_policy defined by app rabbit
2025-03-20 00:45:10.292 [info] <0.310.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2025-03-20 00:45:10.292 [info] <0.310.0> Running boot step rabbit_vhost_limit defined by app rabbit
2025-03-20 00:45:10.293 [info] <0.310.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2025-03-20 00:45:10.293 [info] <0.310.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2025-03-20 00:45:10.293 [warning] <0.310.0> force_fine_statistics set to true; ignored.
Replaced by {rates_mode, none} in the rabbitmq_management application.
2025-03-20 00:45:10.293 [info] <0.310.0> Management plugin: using rates mode 'basic'
2025-03-20 00:45:10.294 [info] <0.310.0> Running boot step recovery defined by app rabbit
2025-03-20 00:45:10.295 [info] <0.455.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2025-03-20 00:45:10.300 [info] <0.455.0> Starting message stores for vhost '/'
2025-03-20 00:45:10.300 [info] <0.459.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2025-03-20 00:45:10.301 [info] <0.455.0> Started message store of type transient for vhost '/'
2025-03-20 00:45:10.301 [info] <0.462.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2025-03-20 00:45:10.303 [info] <0.455.0> Started message store of type persistent for vhost '/'
2025-03-20 00:45:10.305 [info] <0.310.0> Running boot step load_definitions defined by app rabbitmq_management
2025-03-20 00:45:10.305 [info] <0.310.0> Applying definitions from /etc/rabbitmq/definitions.json
2025-03-20 00:45:10.305 [info] <0.310.0> Asked to import definitions. Acting user: rmq-internal
2025-03-20 00:45:10.305 [info] <0.310.0> Importing users...
2025-03-20 00:45:10.311 [info] <0.310.0> Setting user tags for user 'guest' to [administrator]
2025-03-20 00:45:10.316 [info] <0.310.0> Importing vhosts...
2025-03-20 00:45:10.317 [info] <0.310.0> Importing user permissions...
2025-03-20 00:45:10.317 [info] <0.310.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*'
2025-03-20 00:45:10.321 [info] <0.310.0> Importing topic permissions...
2025-03-20 00:45:10.321 [info] <0.310.0> Importing parameters...
2025-03-20 00:45:10.321 [info] <0.310.0> Importing global parameters...
2025-03-20 00:45:10.321 [info] <0.310.0> Importing policies...
2025-03-20 00:45:10.325 [info] <0.310.0> Importing queues...
2025-03-20 00:45:10.325 [info] <0.310.0> Importing exchanges...
2025-03-20 00:45:10.325 [info] <0.310.0> Importing bindings...
2025-03-20 00:45:10.325 [info] <0.310.0> Running boot step empty_db_check defined by app rabbit
2025-03-20 00:45:10.325 [info] <0.310.0> Running boot step rabbit_looking_glass defined by app rabbit
2025-03-20 00:45:10.325 [info] <0.310.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2025-03-20 00:45:10.325 [info] <0.310.0> Running boot step background_gc defined by app rabbit
2025-03-20 00:45:10.325 [info] <0.310.0> Running boot step connection_tracking defined by app rabbit
2025-03-20 00:45:10.326 [info] <0.310.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 00:45:10.326 [info] <0.310.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 00:45:10.326 [info] <0.310.0> Running boot step routing_ready defined by app rabbit
2025-03-20 00:45:10.326 [info] <0.310.0> Running boot step pre_flight defined by app rabbit
2025-03-20 00:45:10.327 [info] <0.310.0> Running boot step notify_cluster defined by app rabbit
2025-03-20 00:45:10.327 [info] <0.310.0> Running boot step networking defined by app rabbit
2025-03-20 00:45:10.327 [info] <0.418.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' up
2025-03-20 00:45:10.329 [info] <0.503.0> started TCP listener on [::]:5673
2025-03-20 00:45:10.329 [info] <0.310.0> Running boot step cluster_name defined by app rabbit
2025-03-20 00:45:10.329 [info] <0.310.0> Running boot step direct_client defined by app rabbit
2025-03-20 00:45:10.329 [info] <0.310.0> Running boot step os_signal_handler defined by app rabbit
2025-03-20 00:45:10.329 [info] <0.505.0> Swapping OS signal event handler (erl_signal_server) for our own
2025-03-20 00:45:10.360 [info] <0.556.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2025-03-20 00:45:10.360 [info] <0.662.0> Statistics database started.
2025-03-20 00:45:10.360 [info] <0.661.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2025-03-20 00:45:10.361 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50
2025-03-20 00:45:10.433 [info] <0.8.0> Server startup complete; 3 plugins started.
 * rabbitmq_management
 * rabbitmq_management_agent
 * rabbitmq_web_dispatch
2025-03-20 00:45:17.953 [info] <0.418.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up
2025-03-20 00:45:18.333 [info] <0.418.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' down
2025-03-20 00:45:18.342 [info] <0.418.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2923-3 listeners: the node is already back
2025-03-20 00:45:28.080 [info] <0.418.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' down: connection_closed
2025-03-20 00:45:28.956 [info] <0.418.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up
2025-03-20 00:45:31.431 [info] <0.418.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' down: connection_closed
2025-03-20 00:45:36.999 [info] <0.418.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up
2025-03-20 00:45:37.309 [info] <0.418.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up
2025-03-20 01:52:39.188 [info] <0.418.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' down
2025-03-20 01:52:39.201 [info] <0.418.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2923-3 listeners: the node is already back
2025-03-20 01:52:39.218 [info] <0.418.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' down: connection_closed
2025-03-20 01:52:39.319 [info] <0.1203.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-3.-8082-0' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1203.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.863.0>
2025-03-20 01:52:39.319 [info] <0.1537.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1537.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1207.0>
2025-03-20 01:52:39.320 [info] <0.1181.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..tftp_queue' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1181.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.840.0>
2025-03-20 01:52:39.321 [info] <0.1570.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1570.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1243.0>
2025-03-20 01:52:39.321 [info] <0.1374.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1374.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1039.0>
2025-03-20 01:52:39.322 [info] <0.1592.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1592.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1267.0>
2025-03-20 01:52:39.323 [info] <0.1504.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1504.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1172.0>
2025-03-20 01:52:39.324 [info] <0.1135.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1135.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.792.0>
2025-03-20 01:52:39.325 [info] <0.1581.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1581.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1255.0>
2025-03-20 01:52:39.326 [info] <0.1271.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-2.-8082-0' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1271.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.933.0>
2025-03-20 01:52:39.327 [info] <0.1559.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1559.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1231.0>
2025-03-20 01:52:39.328 [info] <0.1442.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1442.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1109.0>
2025-03-20 01:52:39.328 [info] <0.1548.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1548.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1219.0>
2025-03-20 01:52:39.331 [info] <0.1454.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.2.1454.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.1122.0>
2025-03-20 01:52:39.580 [info] <0.1789.0> RabbitMQ is asked to stop...
2025-03-20 01:52:39.679 [info] <0.1789.0> Stopping RabbitMQ applications and their dependencies in the following order:
    rabbitmq_management
    amqp_client
    rabbitmq_web_dispatch
    cowboy
    cowlib
    rabbitmq_management_agent
    rabbit
    mnesia
    rabbit_common
    sysmon_handler
    os_mon
2025-03-20 01:52:39.679 [info] <0.1789.0> Stopping application 'rabbitmq_management'
2025-03-20 01:52:39.681 [warning] <0.511.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls
2025-03-20 01:52:39.682 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped
2025-03-20 01:52:39.682 [info] <0.1789.0> Stopping application 'amqp_client'
2025-03-20 01:52:39.684 [info] <0.43.0> Application amqp_client exited with reason: stopped
2025-03-20 01:52:39.684 [info] <0.1789.0> Stopping application 'rabbitmq_web_dispatch'
2025-03-20 01:52:39.686 [info] <0.1789.0> Stopping application 'cowboy'
2025-03-20 01:52:39.686 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped
2025-03-20 01:52:39.688 [info] <0.1789.0> Stopping application 'cowlib'
2025-03-20 01:52:39.688 [info] <0.43.0> Application cowboy exited with reason: stopped
2025-03-20 01:52:39.688 [info] <0.43.0> Application cowlib exited with reason: stopped
2025-03-20 01:52:39.688 [info] <0.1789.0> Stopping application 'rabbitmq_management_agent'
2025-03-20 01:52:39.690 [info] <0.1789.0> Stopping application 'rabbit'
2025-03-20 01:52:39.690 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped
2025-03-20 01:52:39.690 [info] <0.310.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 01:52:39.690 [info] <0.503.0> stopped TCP listener on [::]:5673
2025-03-20 01:52:39.691 [info] <0.443.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2' because the vhost is stopping
2025-03-20 01:52:39.692 [info] <0.462.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent'
2025-03-20 01:52:39.699 [info] <0.462.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped
2025-03-20 01:52:39.699 [info] <0.459.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient'
2025-03-20 01:52:39.703 [info] <0.459.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped
2025-03-20 01:52:39.711 [info] <0.1789.0> Stopping application 'mnesia'
2025-03-20 01:52:39.711 [info] <0.43.0> Application rabbit exited with reason: stopped
2025-03-20 01:52:39.714 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 01:52:39.714 [info] <0.1789.0> Stopping application 'rabbit_common'
2025-03-20 01:52:39.714 [info] <0.43.0> Application rabbit_common exited with reason: stopped
2025-03-20 01:52:39.714 [info] <0.1789.0> Stopping application 'sysmon_handler'
2025-03-20 01:52:39.716 [info] <0.1789.0> Stopping application 'os_mon'
2025-03-20 01:52:39.716 [info] <0.43.0> Application sysmon_handler exited with reason: stopped
2025-03-20 01:52:39.719 [info] <0.1789.0> Successfully stopped RabbitMQ and its dependencies
2025-03-20 01:52:39.719 [info] <0.43.0> Application os_mon exited with reason: stopped
2025-03-20 01:53:10.669 [info] <0.8.0> Log file opened with Lager
2025-03-20 01:53:24.486 [info] <0.8.0> Feature flags: list of feature flags found:
2025-03-20 01:53:24.495 [info] <0.8.0> Feature flags: feature flag states written to disk: yes
2025-03-20 01:53:24.980 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 01:53:25.119 [info] <0.319.0> 
 Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21
 Copyright (c) 2007-2020 Pivotal Software, Inc.
 Licensed under the MPL.  See https://www.rabbitmq.com/
2025-03-20 01:53:25.120 [info] <0.319.0> 
 node           : contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
 home dir       : /var/lib/rabbitmq
 config file(s) : /etc/rabbitmq/rabbitmq.config
 cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
 log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
                : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2_upgrade.log
 database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
2025-03-20 01:53:25.190 [info] <0.319.0> Running boot step pre_boot defined by app rabbit
2025-03-20 01:53:25.190 [info] <0.319.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-03-20 01:53:25.191 [info] <0.319.0> Running boot step rabbit_alarm defined by app rabbit
2025-03-20 01:53:25.225 [info] <0.365.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total
2025-03-20 01:53:25.245 [info] <0.376.0> Enabling free disk space monitoring
2025-03-20 01:53:25.245 [info] <0.376.0> Disk free limit set to 50MB
2025-03-20 01:53:25.311 [info] <0.319.0> Running boot step code_server_cache defined by app rabbit
2025-03-20 01:53:25.311 [info] <0.319.0> Running boot step file_handle_cache defined by app rabbit
2025-03-20 01:53:25.312 [info] <0.393.0> FHC read buffering:  OFF
2025-03-20 01:53:25.312 [info] <0.393.0> FHC write buffering: ON
2025-03-20 01:53:25.312 [info] <0.392.0> Limiting to approx 65436 file handles (58890 sockets)
2025-03-20 01:53:25.323 [info] <0.319.0> Running boot step worker_pool defined by app rabbit
2025-03-20 01:53:25.323 [info] <0.323.0> Will use 4 processes for default worker pool
2025-03-20 01:53:25.323 [info] <0.323.0> Starting worker pool 'worker_pool' with 4 processes in it
2025-03-20 01:53:25.323 [info] <0.319.0> Running boot step database defined by app rabbit
2025-03-20 01:53:25.354 [info] <0.319.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 01:53:25.358 [info] <0.319.0> Successfully synced tables from a peer
2025-03-20 01:53:25.375 [info] <0.319.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 01:53:25.375 [info] <0.319.0> Successfully synced tables from a peer
2025-03-20 01:53:25.512 [info] <0.319.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 01:53:25.512 [info] <0.319.0> Successfully synced tables from a peer
2025-03-20 01:53:25.512 [info] <0.319.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 01:53:25.512 [info] <0.319.0> Running boot step database_sync defined by app rabbit
2025-03-20 01:53:25.512 [info] <0.319.0> Running boot step feature_flags defined by app rabbit
2025-03-20 01:53:25.512 [info] <0.319.0> Running boot step codec_correctness_check defined by app rabbit
2025-03-20 01:53:25.512 [info] <0.319.0> Running boot step external_infrastructure defined by app rabbit
2025-03-20 01:53:25.512 [info] <0.319.0> Running boot step rabbit_registry defined by app rabbit
2025-03-20 01:53:25.512 [info] <0.319.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2025-03-20 01:53:25.513 [info] <0.319.0> Running boot step rabbit_queue_location_random defined by app rabbit
2025-03-20 01:53:25.513 [info] <0.319.0> Running boot step rabbit_event defined by app rabbit
2025-03-20 01:53:25.513 [info] <0.319.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2025-03-20 01:53:25.513 [info] <0.319.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2025-03-20 01:53:25.513 [info] <0.319.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2025-03-20 01:53:25.513 [info] <0.319.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2025-03-20 01:53:25.513 [info] <0.319.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2025-03-20 01:53:25.513 [info] <0.319.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2025-03-20 01:53:25.514 [info] <0.319.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2025-03-20 01:53:25.514 [info] <0.319.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2025-03-20 01:53:25.514 [info] <0.319.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2025-03-20 01:53:25.514 [info] <0.319.0> Running boot step rabbit_priority_queue defined by app rabbit
2025-03-20 01:53:25.514 [info] <0.319.0> Priority queues enabled, real BQ is rabbit_variable_queue
2025-03-20 01:53:25.514 [info] <0.319.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2025-03-20 01:53:25.514 [info] <0.319.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2025-03-20 01:53:25.514 [info] <0.319.0> Running boot step kernel_ready defined by app rabbit
2025-03-20 01:53:25.514 [info] <0.319.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2025-03-20 01:53:25.514 [info] <0.319.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2025-03-20 01:53:25.515 [info] <0.422.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2025-03-20 01:53:25.515 [info] <0.319.0> Running boot step guid_generator defined by app rabbit
2025-03-20 01:53:25.534 [info] <0.319.0> Running boot step rabbit_node_monitor defined by app rabbit
2025-03-20 01:53:25.536 [info] <0.426.0> Starting rabbit_node_monitor
2025-03-20 01:53:25.537 [info] <0.319.0> Running boot step delegate_sup defined by app rabbit
2025-03-20 01:53:25.537 [info] <0.319.0> Running boot step rabbit_memory_monitor defined by app rabbit
2025-03-20 01:53:25.537 [info] <0.319.0> Running boot step core_initialized defined by app rabbit
2025-03-20 01:53:25.537 [info] <0.319.0> Running boot step upgrade_queues defined by app rabbit
2025-03-20 01:53:25.622 [info] <0.319.0> Running boot step rabbit_connection_tracking defined by app rabbit
2025-03-20 01:53:25.622 [info] <0.319.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2025-03-20 01:53:25.631 [info] <0.319.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2025-03-20 01:53:25.631 [info] <0.319.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2025-03-20 01:53:25.631 [info] <0.319.0> Running boot step rabbit_policies defined by app rabbit
2025-03-20 01:53:25.632 [info] <0.319.0> Running boot step rabbit_policy defined by app rabbit
2025-03-20 01:53:25.632 [info] <0.319.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2025-03-20 01:53:25.632 [info] <0.319.0> Running boot step rabbit_vhost_limit defined by app rabbit
2025-03-20 01:53:25.632 [info] <0.319.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2025-03-20 01:53:25.632 [info] <0.319.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2025-03-20 01:53:25.632 [warning] <0.319.0> force_fine_statistics set to true; ignored.
Replaced by {rates_mode, none} in the rabbitmq_management application.
2025-03-20 01:53:25.632 [info] <0.319.0> Management plugin: using rates mode 'basic'
2025-03-20 01:53:25.635 [info] <0.319.0> Running boot step recovery defined by app rabbit
2025-03-20 01:53:25.636 [info] <0.463.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2025-03-20 01:53:25.669 [info] <0.463.0> Starting message stores for vhost '/'
2025-03-20 01:53:25.675 [info] <0.467.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2025-03-20 01:53:25.679 [info] <0.463.0> Started message store of type transient for vhost '/'
2025-03-20 01:53:25.679 [info] <0.470.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2025-03-20 01:53:25.702 [info] <0.463.0> Started message store of type persistent for vhost '/'
2025-03-20 01:53:25.704 [info] <0.463.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.489.0>
2025-03-20 01:53:25.704 [info] <0.463.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.493.0>
2025-03-20 01:53:25.705 [info] <0.463.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.497.0>
2025-03-20 01:53:25.705 [info] <0.463.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.501.0>
2025-03-20 01:53:25.706 [info] <0.463.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.505.0>
2025-03-20 01:53:25.709 [info] <0.463.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.509.0>
2025-03-20 01:53:25.711 [info] <0.463.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.513.0>
2025-03-20 01:53:25.711 [info] <0.463.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.517.0>
2025-03-20 01:53:25.711 [info] <0.463.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.521.0>
2025-03-20 01:53:25.712 [info] <0.463.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.525.0>
2025-03-20 01:53:25.712 [info] <0.463.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.529.0>
2025-03-20 01:53:25.712 [info] <0.463.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.533.0>
2025-03-20 01:53:25.712 [info] <0.463.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.537.0>
2025-03-20 01:53:25.713 [info] <0.463.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.541.0>
2025-03-20 01:53:25.713 [info] <0.463.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.545.0>
2025-03-20 01:53:25.713 [info] <0.463.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.549.0>
2025-03-20 01:53:25.713 [info] <0.463.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.553.0>
2025-03-20 01:53:25.713 [info] <0.463.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.557.0>
2025-03-20 01:53:25.714 [info] <0.463.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.561.0>
2025-03-20 01:53:25.714 [info] <0.463.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.565.0>
2025-03-20 01:53:25.714 [info] <0.463.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.569.0>
2025-03-20 01:53:25.714 [info] <0.463.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.573.0>
2025-03-20 01:53:25.715 [info] <0.463.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.577.0>
2025-03-20 01:53:25.715 [info] <0.463.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.581.0>
2025-03-20 01:53:25.715 [info] <0.463.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.585.0>
2025-03-20 01:53:25.715 [info] <0.463.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.589.0>
2025-03-20 01:53:25.722 [info] <0.319.0> Running boot step load_definitions defined by app rabbitmq_management
2025-03-20 01:53:25.732 [info] <0.319.0> Applying definitions from /etc/rabbitmq/definitions.json
2025-03-20 01:53:25.732 [info] <0.319.0> Asked to import definitions. Acting user: rmq-internal
2025-03-20 01:53:25.732 [info] <0.319.0> Importing users...
2025-03-20 01:53:25.752 [info] <0.319.0> Setting user tags for user 'guest' to [administrator]
2025-03-20 01:53:25.787 [info] <0.319.0> Importing vhosts...
2025-03-20 01:53:25.787 [info] <0.319.0> Importing user permissions...
2025-03-20 01:53:25.787 [info] <0.319.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*'
2025-03-20 01:53:25.865 [info] <0.319.0> Importing topic permissions...
2025-03-20 01:53:25.865 [info] <0.319.0> Importing parameters...
2025-03-20 01:53:25.865 [info] <0.319.0> Importing global parameters...
2025-03-20 01:53:25.865 [info] <0.319.0> Importing policies...
2025-03-20 01:53:25.899 [info] <0.319.0> Importing queues...
2025-03-20 01:53:25.901 [info] <0.319.0> Importing exchanges...
2025-03-20 01:53:25.904 [info] <0.319.0> Importing bindings...
2025-03-20 01:53:25.904 [info] <0.319.0> Running boot step empty_db_check defined by app rabbit
2025-03-20 01:53:25.904 [info] <0.319.0> Running boot step rabbit_looking_glass defined by app rabbit
2025-03-20 01:53:25.904 [info] <0.319.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2025-03-20 01:53:25.904 [info] <0.319.0> Running boot step background_gc defined by app rabbit
2025-03-20 01:53:25.908 [info] <0.319.0> Running boot step connection_tracking defined by app rabbit
2025-03-20 01:53:25.912 [info] <0.319.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 01:53:25.915 [info] <0.319.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 01:53:25.915 [info] <0.319.0> Running boot step routing_ready defined by app rabbit
2025-03-20 01:53:25.915 [info] <0.319.0> Running boot step pre_flight defined by app rabbit
2025-03-20 01:53:25.915 [info] <0.319.0> Running boot step notify_cluster defined by app rabbit
2025-03-20 01:53:25.915 [info] <0.319.0> Running boot step networking defined by app rabbit
2025-03-20 01:53:25.917 [info] <0.426.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' up
2025-03-20 01:53:25.924 [info] <0.693.0> started TCP listener on [::]:5673
2025-03-20 01:53:25.927 [info] <0.319.0> Running boot step cluster_name defined by app rabbit
2025-03-20 01:53:25.930 [info] <0.319.0> Running boot step direct_client defined by app rabbit
2025-03-20 01:53:25.937 [info] <0.319.0> Running boot step os_signal_handler defined by app rabbit
2025-03-20 01:53:25.937 [info] <0.696.0> Swapping OS signal event handler (erl_signal_server) for our own
2025-03-20 01:53:26.191 [info] <0.772.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2025-03-20 01:53:26.191 [info] <0.879.0> Statistics database started.
2025-03-20 01:53:26.191 [info] <0.878.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2025-03-20 01:53:26.192 [notice] <0.116.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50
2025-03-20 01:53:27.803 [info] <0.8.0> Server startup complete; 3 plugins started.
 * rabbitmq_management
 * rabbitmq_web_dispatch
 * rabbitmq_management_agent
2025-03-20 01:53:38.924 [info] <0.1135.0> RabbitMQ is asked to stop...
2025-03-20 01:53:39.244 [info] <0.1135.0> Stopping RabbitMQ applications and their dependencies in the following order:
    rabbitmq_management
    amqp_client
    rabbitmq_web_dispatch
    cowboy
    cowlib
    rabbitmq_management_agent
    rabbit
    mnesia
    rabbit_common
    sysmon_handler
    os_mon
2025-03-20 01:53:39.245 [info] <0.1135.0> Stopping application 'rabbitmq_management'
2025-03-20 01:53:39.248 [warning] <0.768.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls
2025-03-20 01:53:39.250 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped
2025-03-20 01:53:39.250 [info] <0.1135.0> Stopping application 'amqp_client'
2025-03-20 01:53:39.252 [info] <0.43.0> Application amqp_client exited with reason: stopped
2025-03-20 01:53:39.252 [info] <0.1135.0> Stopping application 'rabbitmq_web_dispatch'
2025-03-20 01:53:39.253 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped
2025-03-20 01:53:39.253 [info] <0.1135.0> Stopping application 'cowboy'
2025-03-20 01:53:39.255 [info] <0.43.0> Application cowboy exited with reason: stopped
2025-03-20 01:53:39.255 [info] <0.1135.0> Stopping application 'cowlib'
2025-03-20 01:53:39.255 [info] <0.43.0> Application cowlib exited with reason: stopped
2025-03-20 01:53:39.255 [info] <0.1135.0> Stopping application 'rabbitmq_management_agent'
2025-03-20 01:53:39.267 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped
2025-03-20 01:53:39.267 [info] <0.1135.0> Stopping application 'rabbit'
2025-03-20 01:53:39.267 [info] <0.319.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 01:53:39.268 [info] <0.693.0> stopped TCP listener on [::]:5673
2025-03-20 01:53:39.271 [info] <0.451.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2' because the vhost is stopping
2025-03-20 01:53:39.273 [info] <0.470.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent'
2025-03-20 01:53:39.294 [info] <0.470.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped
2025-03-20 01:53:39.294 [info] <0.467.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient'
2025-03-20 01:53:39.318 [info] <0.467.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped
2025-03-20 01:53:39.329 [info] <0.43.0> Application rabbit exited with reason: stopped
2025-03-20 01:53:39.335 [info] <0.1135.0> Stopping application 'mnesia'
2025-03-20 01:53:39.356 [info] <0.1135.0> Stopping application 'rabbit_common'
2025-03-20 01:53:39.356 [info] <0.1135.0> Stopping application 'sysmon_handler'
2025-03-20 01:53:39.356 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 01:53:39.357 [info] <0.43.0> Application rabbit_common exited with reason: stopped
2025-03-20 01:53:39.364 [info] <0.43.0> Application sysmon_handler exited with reason: stopped
2025-03-20 01:53:39.364 [info] <0.1135.0> Stopping application 'os_mon'
2025-03-20 01:53:39.368 [info] <0.43.0> Application os_mon exited with reason: stopped
2025-03-20 01:53:39.368 [info] <0.1135.0> Successfully stopped RabbitMQ and its dependencies
2025-03-20 01:53:39.368 [info] <0.1135.0> Halting Erlang VM with the following applications:
    jsx
    ranch
    ssl
    public_key
    asn1
    stdout_formatter
    xmerl
    inets
    tools
    observer_cli
    recon
    credentials_obfuscation
    crypto
    lager
    goldrush
    compiler
    syntax_tools
    sasl
    stdlib
    kernel
2025-03-20 01:54:02.743 [info] <0.8.0> Log file opened with Lager
2025-03-20 01:54:10.392 [info] <0.8.0> Feature flags: list of feature flags found:
2025-03-20 01:54:10.395 [info] <0.8.0> Feature flags: feature flag states written to disk: yes
2025-03-20 01:54:10.658 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 01:54:10.806 [info] <0.308.0> 
 Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21
 Copyright (c) 2007-2020 Pivotal Software, Inc.
 Licensed under the MPL.  See https://www.rabbitmq.com/
2025-03-20 01:54:10.810 [info] <0.308.0> 
 node           : contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
 home dir       : /var/lib/rabbitmq
 config file(s) : /etc/rabbitmq/rabbitmq.config
 cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
 log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
                : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2_upgrade.log
 database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
2025-03-20 01:54:10.833 [info] <0.308.0> Running boot step pre_boot defined by app rabbit
2025-03-20 01:54:10.833 [info] <0.308.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-03-20 01:54:10.833 [info] <0.308.0> Running boot step rabbit_alarm defined by app rabbit
2025-03-20 01:54:10.855 [info] <0.329.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total
2025-03-20 01:54:10.895 [info] <0.337.0> Enabling free disk space monitoring
2025-03-20 01:54:10.896 [info] <0.337.0> Disk free limit set to 50MB
2025-03-20 01:54:10.918 [info] <0.308.0> Running boot step code_server_cache defined by app rabbit
2025-03-20 01:54:10.919 [info] <0.308.0> Running boot step file_handle_cache defined by app rabbit
2025-03-20 01:54:10.919 [info] <0.355.0> Limiting to approx 65436 file handles (58890 sockets)
2025-03-20 01:54:10.919 [info] <0.358.0> FHC read buffering:  OFF
2025-03-20 01:54:10.919 [info] <0.358.0> FHC write buffering: ON
2025-03-20 01:54:10.921 [info] <0.308.0> Running boot step worker_pool defined by app rabbit
2025-03-20 01:54:10.921 [info] <0.309.0> Will use 4 processes for default worker pool
2025-03-20 01:54:10.921 [info] <0.309.0> Starting worker pool 'worker_pool' with 4 processes in it
2025-03-20 01:54:10.921 [info] <0.308.0> Running boot step database defined by app rabbit
2025-03-20 01:54:11.022 [info] <0.308.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 01:54:11.029 [info] <0.308.0> Successfully synced tables from a peer
2025-03-20 01:54:11.038 [info] <0.308.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 01:54:11.038 [info] <0.308.0> Successfully synced tables from a peer
2025-03-20 01:54:11.169 [info] <0.308.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 01:54:11.169 [info] <0.308.0> Successfully synced tables from a peer
2025-03-20 01:54:11.169 [info] <0.308.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 01:54:11.169 [info] <0.308.0> Running boot step database_sync defined by app rabbit
2025-03-20 01:54:11.169 [info] <0.308.0> Running boot step feature_flags defined by app rabbit
2025-03-20 01:54:11.169 [info] <0.308.0> Running boot step codec_correctness_check defined by app rabbit
2025-03-20 01:54:11.169 [info] <0.308.0> Running boot step external_infrastructure defined by app rabbit
2025-03-20 01:54:11.169 [info] <0.308.0> Running boot step rabbit_registry defined by app rabbit
2025-03-20 01:54:11.169 [info] <0.308.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2025-03-20 01:54:11.169 [info] <0.308.0> Running boot step rabbit_queue_location_random defined by app rabbit
2025-03-20 01:54:11.169 [info] <0.308.0> Running boot step rabbit_event defined by app rabbit
2025-03-20 01:54:11.170 [info] <0.308.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2025-03-20 01:54:11.170 [info] <0.308.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2025-03-20 01:54:11.170 [info] <0.308.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2025-03-20 01:54:11.170 [info] <0.308.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2025-03-20 01:54:11.170 [info] <0.308.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2025-03-20 01:54:11.170 [info] <0.308.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2025-03-20 01:54:11.170 [info] <0.308.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2025-03-20 01:54:11.171 [info] <0.308.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2025-03-20 01:54:11.171 [info] <0.308.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2025-03-20 01:54:11.171 [info] <0.308.0> Running boot step rabbit_priority_queue defined by app rabbit
2025-03-20 01:54:11.171 [info] <0.308.0> Priority queues enabled, real BQ is rabbit_variable_queue
2025-03-20 01:54:11.172 [info] <0.308.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2025-03-20 01:54:11.172 [info] <0.308.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2025-03-20 01:54:11.172 [info] <0.308.0> Running boot step kernel_ready defined by app rabbit
2025-03-20 01:54:11.172 [info] <0.308.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2025-03-20 01:54:11.172 [info] <0.308.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2025-03-20 01:54:11.173 [info] <0.411.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2025-03-20 01:54:11.173 [info] <0.308.0> Running boot step guid_generator defined by app rabbit
2025-03-20 01:54:11.187 [info] <0.308.0> Running boot step rabbit_node_monitor defined by app rabbit
2025-03-20 01:54:11.191 [info] <0.415.0> Starting rabbit_node_monitor
2025-03-20 01:54:11.191 [info] <0.308.0> Running boot step delegate_sup defined by app rabbit
2025-03-20 01:54:11.192 [info] <0.308.0> Running boot step rabbit_memory_monitor defined by app rabbit
2025-03-20 01:54:11.192 [info] <0.308.0> Running boot step core_initialized defined by app rabbit
2025-03-20 01:54:11.192 [info] <0.308.0> Running boot step upgrade_queues defined by app rabbit
2025-03-20 01:54:11.299 [info] <0.308.0> Running boot step rabbit_connection_tracking defined by app rabbit
2025-03-20 01:54:11.299 [info] <0.308.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2025-03-20 01:54:11.299 [info] <0.308.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2025-03-20 01:54:11.300 [info] <0.308.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2025-03-20 01:54:11.300 [info] <0.308.0> Running boot step rabbit_policies defined by app rabbit
2025-03-20 01:54:11.301 [info] <0.308.0> Running boot step rabbit_policy defined by app rabbit
2025-03-20 01:54:11.301 [info] <0.308.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2025-03-20 01:54:11.301 [info] <0.308.0> Running boot step rabbit_vhost_limit defined by app rabbit
2025-03-20 01:54:11.301 [info] <0.308.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2025-03-20 01:54:11.301 [info] <0.308.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2025-03-20 01:54:11.301 [warning] <0.308.0> force_fine_statistics set to true; ignored.
Replaced by {rates_mode, none} in the rabbitmq_management application.
2025-03-20 01:54:11.301 [info] <0.308.0> Management plugin: using rates mode 'basic'
2025-03-20 01:54:11.313 [info] <0.308.0> Running boot step recovery defined by app rabbit
2025-03-20 01:54:11.316 [info] <0.452.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2025-03-20 01:54:11.327 [info] <0.452.0> Starting message stores for vhost '/'
2025-03-20 01:54:11.329 [info] <0.456.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2025-03-20 01:54:11.340 [info] <0.452.0> Started message store of type transient for vhost '/'
2025-03-20 01:54:11.340 [info] <0.459.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2025-03-20 01:54:11.349 [info] <0.452.0> Started message store of type persistent for vhost '/'
2025-03-20 01:54:11.351 [info] <0.452.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.478.0>
2025-03-20 01:54:11.352 [info] <0.452.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.482.0>
2025-03-20 01:54:11.353 [info] <0.452.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.486.0>
2025-03-20 01:54:11.354 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.490.0>
2025-03-20 01:54:11.355 [info] <0.452.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.494.0>
2025-03-20 01:54:11.356 [info] <0.452.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.498.0>
2025-03-20 01:54:11.356 [info] <0.452.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.502.0>
2025-03-20 01:54:11.357 [info] <0.452.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.506.0>
2025-03-20 01:54:11.357 [info] <0.452.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.510.0>
2025-03-20 01:54:11.357 [info] <0.452.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.514.0>
2025-03-20 01:54:11.358 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.518.0>
2025-03-20 01:54:11.358 [info] <0.452.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.522.0>
2025-03-20 01:54:11.358 [info] <0.452.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.526.0>
2025-03-20 01:54:11.358 [info] <0.452.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.530.0>
2025-03-20 01:54:11.359 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.534.0>
2025-03-20 01:54:11.360 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.538.0>
2025-03-20 01:54:11.360 [info] <0.452.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.542.0>
2025-03-20 01:54:11.360 [info] <0.452.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.546.0>
2025-03-20 01:54:11.361 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.550.0>
2025-03-20 01:54:11.361 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.554.0>
2025-03-20 01:54:11.361 [info] <0.452.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.558.0>
2025-03-20 01:54:11.362 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.562.0>
2025-03-20 01:54:11.362 [info] <0.452.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.566.0>
2025-03-20 01:54:11.363 [info] <0.452.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.571.0>
2025-03-20 01:54:11.363 [info] <0.452.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.575.0>
2025-03-20 01:54:11.363 [info] <0.452.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.579.0>
2025-03-20 01:54:11.363 [info] <0.452.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.583.0>
2025-03-20 01:54:11.364 [info] <0.452.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.587.0>
2025-03-20 01:54:11.364 [info] <0.452.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.591.0>
2025-03-20 01:54:11.364 [info] <0.452.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.595.0>
2025-03-20 01:54:11.364 [info] <0.452.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.599.0>
2025-03-20 01:54:11.365 [info] <0.452.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-1..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.606.0>
2025-03-20 01:54:11.380 [info] <0.452.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-1..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.617.0>
2025-03-20 01:54:11.380 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.621.0>
2025-03-20 01:54:11.380 [info] <0.452.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.625.0>
2025-03-20 01:54:11.380 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.629.0>
2025-03-20 01:54:11.392 [info] <0.308.0> Running boot step load_definitions defined by app rabbitmq_management
2025-03-20 01:54:11.393 [info] <0.308.0> Applying definitions from /etc/rabbitmq/definitions.json
2025-03-20 01:54:11.394 [info] <0.308.0> Asked to import definitions. Acting user: rmq-internal
2025-03-20 01:54:11.396 [info] <0.308.0> Importing users...
2025-03-20 01:54:11.509 [info] <0.308.0> Setting user tags for user 'guest' to [administrator]
2025-03-20 01:54:11.623 [info] <0.308.0> Importing vhosts...
2025-03-20 01:54:11.623 [info] <0.308.0> Importing user permissions...
2025-03-20 01:54:11.623 [info] <0.308.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*'
2025-03-20 01:54:11.648 [info] <0.308.0> Importing topic permissions...
2025-03-20 01:54:11.648 [info] <0.308.0> Importing parameters...
2025-03-20 01:54:11.648 [info] <0.308.0> Importing global parameters...
2025-03-20 01:54:11.648 [info] <0.308.0> Importing policies...
2025-03-20 01:54:11.670 [info] <0.308.0> Importing queues...
2025-03-20 01:54:11.670 [info] <0.308.0> Importing exchanges...
2025-03-20 01:54:11.670 [info] <0.308.0> Importing bindings...
2025-03-20 01:54:11.670 [info] <0.308.0> Running boot step empty_db_check defined by app rabbit
2025-03-20 01:54:11.670 [info] <0.308.0> Running boot step rabbit_looking_glass defined by app rabbit
2025-03-20 01:54:11.670 [info] <0.308.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2025-03-20 01:54:11.670 [info] <0.308.0> Running boot step background_gc defined by app rabbit
2025-03-20 01:54:11.670 [info] <0.308.0> Running boot step connection_tracking defined by app rabbit
2025-03-20 01:54:11.674 [info] <0.308.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 01:54:11.676 [info] <0.308.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 01:54:11.677 [info] <0.308.0> Running boot step routing_ready defined by app rabbit
2025-03-20 01:54:11.684 [info] <0.308.0> Running boot step pre_flight defined by app rabbit
2025-03-20 01:54:11.685 [info] <0.308.0> Running boot step notify_cluster defined by app rabbit
2025-03-20 01:54:11.685 [info] <0.308.0> Running boot step networking defined by app rabbit
2025-03-20 01:54:11.686 [info] <0.415.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' up
2025-03-20 01:54:11.690 [info] <0.752.0> started TCP listener on [::]:5673
2025-03-20 01:54:11.691 [info] <0.308.0> Running boot step cluster_name defined by app rabbit
2025-03-20 01:54:11.691 [info] <0.308.0> Running boot step direct_client defined by app rabbit
2025-03-20 01:54:11.692 [info] <0.308.0> Running boot step os_signal_handler defined by app rabbit
2025-03-20 01:54:11.692 [info] <0.754.0> Swapping OS signal event handler (erl_signal_server) for our own
2025-03-20 01:54:11.822 [info] <0.415.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up
2025-03-20 01:54:11.959 [info] <0.882.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2025-03-20 01:54:11.960 [info] <0.988.0> Statistics database started.
2025-03-20 01:54:11.960 [info] <0.987.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2025-03-20 01:54:11.960 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50
2025-03-20 01:54:12.368 [info] <0.8.0> Server startup complete; 3 plugins started.
 * rabbitmq_management
 * rabbitmq_web_dispatch
 * rabbitmq_management_agent
2025-03-20 02:00:41.125 [info] <0.1654.0> accepting AMQP connection <0.1654.0> (10.0.0.12:32978 -> 10.0.0.12:5673)
2025-03-20 02:00:41.125 [info] <0.1657.0> accepting AMQP connection <0.1657.0> (10.0.0.47:59916 -> 10.0.0.12:5673)
2025-03-20 02:00:41.125 [info] <0.1660.0> accepting AMQP connection <0.1660.0> (10.0.0.12:32994 -> 10.0.0.12:5673)
2025-03-20 02:00:41.127 [info] <0.1666.0> accepting AMQP connection <0.1666.0> (10.0.0.47:59904 -> 10.0.0.12:5673)
2025-03-20 02:00:41.127 [info] <0.1669.0> accepting AMQP connection <0.1669.0> (10.0.0.42:47706 -> 10.0.0.12:5673)
2025-03-20 02:00:41.127 [info] <0.1663.0> accepting AMQP connection <0.1663.0> (10.0.0.12:32996 -> 10.0.0.12:5673)
2025-03-20 02:00:41.128 [info] <0.1672.0> accepting AMQP connection <0.1672.0> (10.0.0.12:32952 -> 10.0.0.12:5673)
2025-03-20 02:00:41.129 [info] <0.1675.0> accepting AMQP connection <0.1675.0> (10.0.0.42:47722 -> 10.0.0.12:5673)
2025-03-20 02:00:41.129 [info] <0.1678.0> accepting AMQP connection <0.1678.0> (10.0.0.12:32966 -> 10.0.0.12:5673)
2025-03-20 02:00:41.133 [info] <0.1681.0> accepting AMQP connection <0.1681.0> (10.0.0.42:47720 -> 10.0.0.12:5673)
2025-03-20 02:00:41.133 [info] <0.1684.0> accepting AMQP connection <0.1684.0> (10.0.0.12:33010 -> 10.0.0.12:5673)
2025-03-20 02:00:41.134 [info] <0.1663.0> connection <0.1663.0> (10.0.0.12:32996 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.134 [info] <0.1687.0> accepting AMQP connection <0.1687.0> (10.0.0.42:47732 -> 10.0.0.12:5673)
2025-03-20 02:00:41.134 [info] <0.1693.0> accepting AMQP connection <0.1693.0> (10.0.0.47:59940 -> 10.0.0.12:5673)
2025-03-20 02:00:41.134 [info] <0.1696.0> accepting AMQP connection <0.1696.0> (10.0.0.47:59954 -> 10.0.0.12:5673)
2025-03-20 02:00:41.134 [info] <0.1699.0> accepting AMQP connection <0.1699.0> (10.0.0.42:47740 -> 10.0.0.12:5673)
2025-03-20 02:00:41.136 [info] <0.1690.0> accepting AMQP connection <0.1690.0> (10.0.0.47:59932 -> 10.0.0.12:5673)
2025-03-20 02:00:41.136 [info] <0.1711.0> accepting AMQP connection <0.1711.0> (10.0.0.47:59970 -> 10.0.0.12:5673)
2025-03-20 02:00:41.137 [info] <0.1715.0> accepting AMQP connection <0.1715.0> (10.0.0.47:59980 -> 10.0.0.12:5673)
2025-03-20 02:00:41.137 [info] <0.1654.0> connection <0.1654.0> (10.0.0.12:32978 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.139 [info] <0.1726.0> accepting AMQP connection <0.1726.0> (10.0.0.47:59990 -> 10.0.0.12:5673)
2025-03-20 02:00:41.140 [info] <0.1729.0> accepting AMQP connection <0.1729.0> (10.0.0.47:60006 -> 10.0.0.12:5673)
2025-03-20 02:00:41.140 [info] <0.1732.0> accepting AMQP connection <0.1732.0> (10.0.0.42:47748 -> 10.0.0.12:5673)
2025-03-20 02:00:41.140 [info] <0.1708.0> accepting AMQP connection <0.1708.0> (10.0.0.47:59962 -> 10.0.0.12:5673)
2025-03-20 02:00:41.140 [info] <0.1702.0> accepting AMQP connection <0.1702.0> (10.0.0.42:47746 -> 10.0.0.12:5673)
2025-03-20 02:00:41.142 [info] <0.1657.0> connection <0.1657.0> (10.0.0.47:59916 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.143 [info] <0.1693.0> connection <0.1693.0> (10.0.0.47:59940 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.144 [info] <0.1672.0> connection <0.1672.0> (10.0.0.12:32952 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.144 [info] <0.1666.0> connection <0.1666.0> (10.0.0.47:59904 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.144 [info] <0.1675.0> connection <0.1675.0> (10.0.0.42:47722 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.144 [info] <0.1687.0> connection <0.1687.0> (10.0.0.42:47732 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.145 [info] <0.1669.0> connection <0.1669.0> (10.0.0.42:47706 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.147 [info] <0.1660.0> connection <0.1660.0> (10.0.0.12:32994 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.147 [info] <0.1681.0> connection <0.1681.0> (10.0.0.42:47720 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.148 [info] <0.1684.0> connection <0.1684.0> (10.0.0.12:33010 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.151 [info] <0.1715.0> connection <0.1715.0> (10.0.0.47:59980 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.151 [info] <0.1690.0> connection <0.1690.0> (10.0.0.47:59932 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.151 [info] <0.1696.0> connection <0.1696.0> (10.0.0.47:59954 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.152 [info] <0.1802.0> accepting AMQP connection <0.1802.0> (10.0.0.12:33026 -> 10.0.0.12:5673)
2025-03-20 02:00:41.152 [info] <0.1708.0> connection <0.1708.0> (10.0.0.47:59962 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.152 [info] <0.1711.0> connection <0.1711.0> (10.0.0.47:59970 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.153 [info] <0.1729.0> connection <0.1729.0> (10.0.0.47:60006 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.153 [info] <0.1726.0> connection <0.1726.0> (10.0.0.47:59990 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.157 [info] <0.1699.0> connection <0.1699.0> (10.0.0.42:47740 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.157 [info] <0.1678.0> connection <0.1678.0> (10.0.0.12:32966 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.163 [info] <0.1732.0> connection <0.1732.0> (10.0.0.42:47748 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.163 [info] <0.1702.0> connection <0.1702.0> (10.0.0.42:47746 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.167 [info] <0.1802.0> connection <0.1802.0> (10.0.0.12:33026 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/'
2025-03-20 02:00:41.288 [info] <0.415.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' down
2025-03-20 02:00:41.296 [info] <0.1900.0> accepting AMQP connection <0.1900.0> (10.0.0.47:60018 -> 10.0.0.12:5673)
2025-03-20 02:00:42.171 [warning]  lager_file_backend dropped 155 messages in the last second that exceeded the limit of 50 messages/sec
2025-03-20 02:01:11.454 [info] <0.415.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' up
2025-03-20 02:01:40.739 [info] <0.1564.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.739 [info] <0.1564.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.740 [info] <0.1318.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-3..tftp_queue' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.740 [info] <0.1318.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-3..tftp_queue' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.741 [info] <0.2373.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Synchronising: mirrors ['contrail@cn-jenkins-deploy-platform-ansible-os-2923-1'] to sync
2025-03-20 02:01:40.741 [info] <0.1564.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Synchronising: complete
2025-03-20 02:01:40.741 [info] <0.1959.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.741 [info] <0.1959.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.741 [info] <0.1416.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.742 [info] <0.1416.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.755 [info] <0.1513.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.755 [info] <0.1084.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.755 [info] <0.1513.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.756 [info] <0.1084.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.756 [info] <0.1197.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.758 [info] <0.1197.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.762 [info] <0.1465.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.762 [info] <0.1465.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.771 [info] <0.1623.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.771 [info] <0.1623.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.779 [info] <0.1295.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.780 [info] <0.1295.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.785 [info] <0.2374.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-3..tftp_queue' in vhost '/': Synchronising: all slaves already synced
2025-03-20 02:01:40.787 [info] <0.1577.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.787 [info] <0.1577.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.788 [info] <0.1526.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.788 [info] <0.1526.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.789 [info] <0.2378.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Synchronising: all slaves already synced
2025-03-20 02:01:40.789 [info] <0.2377.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Synchronising: all slaves already synced
2025-03-20 02:01:40.791 [info] <0.1501.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.792 [info] <0.1501.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.794 [info] <0.1489.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.794 [info] <0.1489.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.797 [info] <0.1943.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.797 [info] <0.1943.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.797 [info] <0.2381.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: all slaves already synced
2025-03-20 02:01:40.798 [info] <0.1407.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.798 [info] <0.1407.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.798 [info] <0.1003.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: 94 messages to synchronise
2025-03-20 02:01:40.798 [info] <0.1003.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.798 [info] <0.2382.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: all slaves already synced
2025-03-20 02:01:40.799 [info] <0.2384.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: all slaves already synced
2025-03-20 02:01:40.799 [info] <0.1393.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.799 [info] <0.1393.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.800 [info] <0.2383.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Synchronising: all slaves already synced
2025-03-20 02:01:40.800 [info] <0.1647.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:40.800 [info] <0.1647.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Synchronising: batch size: 5
2025-03-20 02:01:40.804 [info] <0.2393.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: mirrors ['contrail@cn-jenkins-deploy-platform-ansible-os-2923-1'] to sync
2025-03-20 02:01:40.805 [info] <0.1003.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Synchronising: complete
2025-03-20 02:01:40.813 [info] <0.1174.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-1.-8082-0' in vhost '/': Synchronising: 0 messages to synchronise
2025-03-20 02:01:41.073 [warning]  lager_file_backend dropped 49 messages in the last second that exceeded the limit of 50 messages/sec
2025-03-20 02:02:17.125 [info] <0.2438.0> RabbitMQ is asked to stop...
2025-03-20 02:02:17.199 [info] <0.2438.0> Stopping RabbitMQ applications and their dependencies in the following order:
    rabbitmq_management
    amqp_client
    rabbitmq_web_dispatch
    cowboy
    cowlib
    rabbitmq_management_agent
    rabbit
    mnesia
    rabbit_common
    sysmon_handler
    os_mon
2025-03-20 02:02:17.199 [info] <0.2438.0> Stopping application 'rabbitmq_management'
2025-03-20 02:02:17.201 [warning] <0.874.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls
2025-03-20 02:02:17.204 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped
2025-03-20 02:02:17.204 [info] <0.2438.0> Stopping application 'amqp_client'
2025-03-20 02:02:17.207 [info] <0.43.0> Application amqp_client exited with reason: stopped
2025-03-20 02:02:17.207 [info] <0.2438.0> Stopping application 'rabbitmq_web_dispatch'
2025-03-20 02:02:17.209 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped
2025-03-20 02:02:17.209 [info] <0.2438.0> Stopping application 'cowboy'
2025-03-20 02:02:17.211 [info] <0.43.0> Application cowboy exited with reason: stopped
2025-03-20 02:02:17.211 [info] <0.2438.0> Stopping application 'cowlib'
2025-03-20 02:02:17.211 [info] <0.43.0> Application cowlib exited with reason: stopped
2025-03-20 02:02:17.211 [info] <0.2438.0> Stopping application 'rabbitmq_management_agent'
2025-03-20 02:02:17.213 [info] <0.2438.0> Stopping application 'rabbit'
2025-03-20 02:02:17.213 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped
2025-03-20 02:02:17.213 [info] <0.308.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 02:02:17.214 [info] <0.752.0> stopped TCP listener on [::]:5673
2025-03-20 02:02:17.214 [error] <0.1732.0> Error on AMQP connection <0.1732.0> (10.0.0.42:47748 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1693.0> Error on AMQP connection <0.1693.0> (10.0.0.47:59940 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1708.0> Error on AMQP connection <0.1708.0> (10.0.0.47:59962 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1699.0> Error on AMQP connection <0.1699.0> (10.0.0.42:47740 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1729.0> Error on AMQP connection <0.1729.0> (10.0.0.47:60006 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1681.0> Error on AMQP connection <0.1681.0> (10.0.0.42:47720 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1715.0> Error on AMQP connection <0.1715.0> (10.0.0.47:59980 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.214 [error] <0.1663.0> Error on AMQP connection <0.1663.0> (10.0.0.12:32996 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1678.0> Error on AMQP connection <0.1678.0> (10.0.0.12:32966 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1726.0> Error on AMQP connection <0.1726.0> (10.0.0.47:59990 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1711.0> Error on AMQP connection <0.1711.0> (10.0.0.47:59970 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1684.0> Error on AMQP connection <0.1684.0> (10.0.0.12:33010 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1672.0> Error on AMQP connection <0.1672.0> (10.0.0.12:32952 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1675.0> Error on AMQP connection <0.1675.0> (10.0.0.42:47722 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1687.0> Error on AMQP connection <0.1687.0> (10.0.0.42:47732 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1696.0> Error on AMQP connection <0.1696.0> (10.0.0.47:59954 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1657.0> Error on AMQP connection <0.1657.0> (10.0.0.47:59916 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1802.0> Error on AMQP connection <0.1802.0> (10.0.0.12:33026 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1660.0> Error on AMQP connection <0.1660.0> (10.0.0.12:32994 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.216 [error] <0.1906.0> Error on AMQP connection <0.1906.0> (10.0.0.12:33032 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.216 [error] <0.1903.0> Error on AMQP connection <0.1903.0> (10.0.0.42:47762 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.216 [error] <0.1916.0> Error on AMQP connection <0.1916.0> (10.0.0.47:60034 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.216 [error] <0.1666.0> Error on AMQP connection <0.1666.0> (10.0.0.47:59904 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.216 [error] <0.1669.0> Error on AMQP connection <0.1669.0> (10.0.0.42:47706 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.214 [error] <0.1702.0> Error on AMQP connection <0.1702.0> (10.0.0.42:47746 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.216 [error] <0.1900.0> Error on AMQP connection <0.1900.0> (10.0.0.47:60018 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1654.0> Error on AMQP connection <0.1654.0> (10.0.0.12:32978 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.215 [error] <0.1690.0> Error on AMQP connection <0.1690.0> (10.0.0.47:59932 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0:
 operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2025-03-20 02:02:17.235 [error] <0.1759.0> Supervisor {<0.1759.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error
2025-03-20 02:02:53.824 [info] <0.8.0> Log file opened with Lager
2025-03-20 02:02:57.520 [info] <0.8.0> Feature flags: list of feature flags found:
2025-03-20 02:02:57.520 [info] <0.8.0> Feature flags: feature flag states written to disk: yes
2025-03-20 02:02:57.555 [info] <0.249.0> 
 Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21
 Copyright (c) 2007-2020 Pivotal Software, Inc.
 Licensed under the MPL.  See https://www.rabbitmq.com/
2025-03-20 02:02:57.556 [info] <0.249.0> 
 node           : contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
 home dir       : /var/lib/rabbitmq
 config file(s) : /etc/rabbitmq/rabbitmq.config
 cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
 log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
                : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2_upgrade.log
 database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
2025-03-20 02:02:57.572 [info] <0.249.0> Running boot step pre_boot defined by app rabbit
2025-03-20 02:02:57.573 [info] <0.249.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-03-20 02:02:57.573 [info] <0.249.0> Running boot step rabbit_alarm defined by app rabbit
2025-03-20 02:02:57.585 [info] <0.255.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total
2025-03-20 02:02:57.601 [info] <0.257.0> Enabling free disk space monitoring
2025-03-20 02:02:57.601 [info] <0.257.0> Disk free limit set to 50MB
2025-03-20 02:02:57.607 [info] <0.249.0> Running boot step code_server_cache defined by app rabbit
2025-03-20 02:02:57.607 [info] <0.249.0> Running boot step file_handle_cache defined by app rabbit
2025-03-20 02:02:57.607 [info] <0.260.0> Limiting to approx 65436 file handles (58890 sockets)
2025-03-20 02:02:57.607 [info] <0.261.0> FHC read buffering:  OFF
2025-03-20 02:02:57.607 [info] <0.261.0> FHC write buffering: ON
2025-03-20 02:02:57.610 [info] <0.249.0> Running boot step worker_pool defined by app rabbit
2025-03-20 02:02:57.610 [info] <0.250.0> Will use 4 processes for default worker pool
2025-03-20 02:02:57.610 [info] <0.250.0> Starting worker pool 'worker_pool' with 4 processes in it
2025-03-20 02:02:57.610 [info] <0.249.0> Running boot step database defined by app rabbit
2025-03-20 02:02:57.612 [info] <0.249.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2 is empty. Assuming we need to join an existing cluster or initialise from scratch...
2025-03-20 02:02:57.612 [info] <0.249.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config
2025-03-20 02:02:57.612 [info] <0.249.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 02:02:57.612 [info] <0.249.0> Peer discovery backend does not support locking, falling back to randomized delay
2025-03-20 02:02:57.612 [info] <0.249.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration.
2025-03-20 02:02:57.612 [info] <0.249.0> Will wait for 37925 milliseconds before proceeding with registration...
2025-03-20 02:03:35.538 [info] <0.249.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-2923-1, contrail@cn-jenkins-deploy-platform-ansible-os-2923-2, contrail@cn-jenkins-deploy-platform-ansible-os-2923-3
2025-03-20 02:03:35.538 [info] <0.249.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-2923-1, contrail@cn-jenkins-deploy-platform-ansible-os-2923-3
2025-03-20 02:03:35.541 [info] <0.249.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' selected for auto-clustering
2025-03-20 02:03:35.620 [info] <0.249.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:03:35.814 [info] <0.249.0> Successfully synced tables from a peer
2025-03-20 02:03:35.817 [info] <0.249.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:03:35.817 [info] <0.249.0> Successfully synced tables from a peer
2025-03-20 02:03:35.972 [info] <0.249.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:03:35.973 [info] <0.249.0> Successfully synced tables from a peer
2025-03-20 02:03:35.975 [info] <0.249.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 02:03:35.976 [info] <0.249.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 02:03:35.976 [info] <0.249.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 02:03:35.976 [info] <0.249.0> Running boot step database_sync defined by app rabbit
2025-03-20 02:03:35.977 [info] <0.249.0> Running boot step feature_flags defined by app rabbit
2025-03-20 02:03:35.977 [info] <0.249.0> Running boot step codec_correctness_check defined by app rabbit
2025-03-20 02:03:35.977 [info] <0.249.0> Running boot step external_infrastructure defined by app rabbit
2025-03-20 02:03:35.977 [info] <0.249.0> Running boot step rabbit_registry defined by app rabbit
2025-03-20 02:03:35.977 [info] <0.249.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2025-03-20 02:03:35.977 [info] <0.249.0> Running boot step rabbit_queue_location_random defined by app rabbit
2025-03-20 02:03:35.977 [info] <0.249.0> Running boot step rabbit_event defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Running boot step rabbit_priority_queue defined by app rabbit
2025-03-20 02:03:35.978 [info] <0.249.0> Priority queues enabled, real BQ is rabbit_variable_queue
2025-03-20 02:03:35.979 [info] <0.249.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2025-03-20 02:03:35.979 [info] <0.249.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2025-03-20 02:03:35.979 [info] <0.249.0> Running boot step kernel_ready defined by app rabbit
2025-03-20 02:03:35.979 [info] <0.249.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2025-03-20 02:03:35.979 [info] <0.249.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2025-03-20 02:03:35.984 [info] <0.415.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2025-03-20 02:03:35.984 [info] <0.249.0> Running boot step guid_generator defined by app rabbit
2025-03-20 02:03:35.993 [info] <0.249.0> Running boot step rabbit_node_monitor defined by app rabbit
2025-03-20 02:03:36.002 [info] <0.419.0> Starting rabbit_node_monitor
2025-03-20 02:03:36.003 [info] <0.249.0> Running boot step delegate_sup defined by app rabbit
2025-03-20 02:03:36.003 [info] <0.249.0> Running boot step rabbit_memory_monitor defined by app rabbit
2025-03-20 02:03:36.004 [info] <0.249.0> Running boot step core_initialized defined by app rabbit
2025-03-20 02:03:36.004 [info] <0.249.0> Running boot step upgrade_queues defined by app rabbit
2025-03-20 02:03:36.049 [info] <0.249.0> message_store upgrades: 1 to apply
2025-03-20 02:03:36.049 [info] <0.249.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2025-03-20 02:03:36.050 [info] <0.249.0> message_store upgrades: No durable queues found. Skipping message store migration
2025-03-20 02:03:36.050 [info] <0.249.0> message_store upgrades: Removing the old message store data
2025-03-20 02:03:36.058 [info] <0.249.0> message_store upgrades: All upgrades applied successfully
2025-03-20 02:03:36.134 [info] <0.249.0> Running boot step rabbit_connection_tracking defined by app rabbit
2025-03-20 02:03:36.135 [info] <0.249.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2025-03-20 02:03:36.135 [info] <0.249.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2025-03-20 02:03:36.136 [info] <0.249.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2025-03-20 02:03:36.137 [info] <0.249.0> Running boot step rabbit_policies defined by app rabbit
2025-03-20 02:03:36.138 [info] <0.249.0> Running boot step rabbit_policy defined by app rabbit
2025-03-20 02:03:36.138 [info] <0.249.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2025-03-20 02:03:36.139 [info] <0.249.0> Running boot step rabbit_vhost_limit defined by app rabbit
2025-03-20 02:03:36.139 [info] <0.249.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2025-03-20 02:03:36.140 [info] <0.249.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2025-03-20 02:03:36.140 [warning] <0.249.0> force_fine_statistics set to true; ignored.
Replaced by {rates_mode, none} in the rabbitmq_management application.
2025-03-20 02:03:36.140 [info] <0.249.0> Management plugin: using rates mode 'basic'
2025-03-20 02:03:36.144 [info] <0.249.0> Running boot step recovery defined by app rabbit
2025-03-20 02:03:36.145 [info] <0.456.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2025-03-20 02:03:36.165 [info] <0.456.0> Starting message stores for vhost '/'
2025-03-20 02:03:36.166 [info] <0.460.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2025-03-20 02:03:36.170 [info] <0.456.0> Started message store of type transient for vhost '/'
2025-03-20 02:03:36.170 [info] <0.463.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2025-03-20 02:03:36.174 [warning] <0.463.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2025-03-20 02:03:36.177 [info] <0.456.0> Started message store of type persistent for vhost '/'
2025-03-20 02:03:36.181 [info] <0.456.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.482.0>
2025-03-20 02:03:36.183 [info] <0.456.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.486.0>
2025-03-20 02:03:36.183 [info] <0.456.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.490.0>
2025-03-20 02:03:36.183 [info] <0.456.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.494.0>
2025-03-20 02:03:36.184 [info] <0.456.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.498.0>
2025-03-20 02:03:36.184 [info] <0.456.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.502.0>
2025-03-20 02:03:36.184 [info] <0.456.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.506.0>
2025-03-20 02:03:36.185 [info] <0.456.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.510.0>
2025-03-20 02:03:36.185 [info] <0.456.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.514.0>
2025-03-20 02:03:36.185 [info] <0.456.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.518.0>
2025-03-20 02:03:36.185 [info] <0.456.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.522.0>
2025-03-20 02:03:36.186 [info] <0.456.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.526.0>
2025-03-20 02:03:36.186 [info] <0.456.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.530.0>
2025-03-20 02:03:36.186 [info] <0.456.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.534.0>
2025-03-20 02:03:36.187 [info] <0.456.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.538.0>
2025-03-20 02:03:36.187 [info] <0.456.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.542.0>
2025-03-20 02:03:36.187 [info] <0.456.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.546.0>
2025-03-20 02:03:36.187 [info] <0.456.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.550.0>
2025-03-20 02:03:36.188 [info] <0.456.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.554.0>
2025-03-20 02:03:36.188 [info] <0.456.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.558.0>
2025-03-20 02:03:36.188 [info] <0.456.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.562.0>
2025-03-20 02:03:36.189 [info] <0.456.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.566.0>
2025-03-20 02:03:36.190 [info] <0.456.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.570.0>
2025-03-20 02:03:36.190 [info] <0.456.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.574.0>
2025-03-20 02:03:36.191 [info] <0.456.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.578.0>
2025-03-20 02:03:36.191 [info] <0.456.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.582.0>
2025-03-20 02:03:36.192 [info] <0.456.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.586.0>
2025-03-20 02:03:36.192 [info] <0.456.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.590.0>
2025-03-20 02:03:36.192 [info] <0.456.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.594.0>
2025-03-20 02:03:36.192 [info] <0.456.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.598.0>
2025-03-20 02:03:36.193 [info] <0.456.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.602.0>
2025-03-20 02:03:36.193 [info] <0.456.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.606.0>
2025-03-20 02:03:36.193 [info] <0.456.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.610.0>
2025-03-20 02:03:36.193 [info] <0.456.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.614.0>
2025-03-20 02:03:36.193 [info] <0.456.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-1..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.618.0>
2025-03-20 02:03:36.194 [info] <0.456.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.622.0>
2025-03-20 02:03:36.194 [info] <0.456.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-1..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.626.0>
2025-03-20 02:03:36.194 [info] <0.456.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.630.0>
2025-03-20 02:03:36.194 [info] <0.456.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.634.0>
2025-03-20 02:03:36.195 [info] <0.456.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.637.0>
2025-03-20 02:03:36.208 [info] <0.456.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.646.0>
2025-03-20 02:03:36.208 [info] <0.249.0> Running boot step load_definitions defined by app rabbitmq_management
2025-03-20 02:03:36.209 [info] <0.249.0> Applying definitions from /etc/rabbitmq/definitions.json
2025-03-20 02:03:36.209 [info] <0.249.0> Asked to import definitions. Acting user: rmq-internal
2025-03-20 02:03:36.209 [info] <0.249.0> Importing users...
2025-03-20 02:03:36.259 [info] <0.249.0> Setting user tags for user 'guest' to [administrator]
2025-03-20 02:03:36.394 [info] <0.249.0> Importing vhosts...
2025-03-20 02:03:36.394 [info] <0.249.0> Importing user permissions...
2025-03-20 02:03:36.394 [info] <0.249.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*'
2025-03-20 02:03:36.509 [info] <0.249.0> Importing topic permissions...
2025-03-20 02:03:36.509 [info] <0.249.0> Importing parameters...
2025-03-20 02:03:36.509 [info] <0.249.0> Importing global parameters...
2025-03-20 02:03:36.509 [info] <0.249.0> Importing policies...
2025-03-20 02:03:36.535 [info] <0.249.0> Importing queues...
2025-03-20 02:03:36.535 [info] <0.249.0> Importing exchanges...
2025-03-20 02:03:36.535 [info] <0.249.0> Importing bindings...
2025-03-20 02:03:36.535 [info] <0.249.0> Running boot step empty_db_check defined by app rabbit
2025-03-20 02:03:36.535 [info] <0.249.0> Running boot step rabbit_looking_glass defined by app rabbit
2025-03-20 02:03:36.535 [info] <0.249.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2025-03-20 02:03:36.535 [info] <0.249.0> Running boot step background_gc defined by app rabbit
2025-03-20 02:03:36.535 [info] <0.249.0> Running boot step connection_tracking defined by app rabbit
2025-03-20 02:03:36.539 [info] <0.249.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 02:03:36.540 [info] <0.249.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 02:03:36.540 [info] <0.249.0> Running boot step routing_ready defined by app rabbit
2025-03-20 02:03:36.540 [info] <0.249.0> Running boot step pre_flight defined by app rabbit
2025-03-20 02:03:36.540 [info] <0.249.0> Running boot step notify_cluster defined by app rabbit
2025-03-20 02:03:36.540 [info] <0.249.0> Running boot step networking defined by app rabbit
2025-03-20 02:03:36.541 [info] <0.419.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up
2025-03-20 02:03:36.549 [info] <0.791.0> started TCP listener on [::]:5673
2025-03-20 02:03:36.555 [info] <0.249.0> Running boot step cluster_name defined by app rabbit
2025-03-20 02:03:36.555 [info] <0.249.0> Running boot step direct_client defined by app rabbit
2025-03-20 02:03:36.555 [info] <0.249.0> Running boot step os_signal_handler defined by app rabbit
2025-03-20 02:03:36.555 [info] <0.793.0> Swapping OS signal event handler (erl_signal_server) for our own
2025-03-20 02:03:36.634 [info] <0.419.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' up
2025-03-20 02:03:36.704 [info] <0.886.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2025-03-20 02:03:36.704 [info] <0.992.0> Statistics database started.
2025-03-20 02:03:36.705 [info] <0.991.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2025-03-20 02:03:36.705 [notice] <0.115.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50
2025-03-20 02:03:37.440 [info] <0.8.0> Server startup complete; 3 plugins started.
 * rabbitmq_management
 * rabbitmq_web_dispatch
 * rabbitmq_management_agent
2025-03-20 02:03:38.210 [info] <0.1045.0> RabbitMQ is asked to stop...
2025-03-20 02:03:38.405 [info] <0.1045.0> Stopping RabbitMQ applications and their dependencies in the following order:
    rabbitmq_management
    amqp_client
    rabbitmq_web_dispatch
    cowboy
    cowlib
    rabbitmq_management_agent
    rabbit
    mnesia
    rabbit_common
    sysmon_handler
    os_mon
2025-03-20 02:03:38.405 [info] <0.1045.0> Stopping application 'rabbitmq_management'
2025-03-20 02:03:38.407 [warning] <0.882.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls
2025-03-20 02:03:38.409 [info] <0.1045.0> Stopping application 'amqp_client'
2025-03-20 02:03:38.409 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped
2025-03-20 02:03:38.411 [info] <0.43.0> Application amqp_client exited with reason: stopped
2025-03-20 02:03:38.411 [info] <0.1045.0> Stopping application 'rabbitmq_web_dispatch'
2025-03-20 02:03:38.419 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped
2025-03-20 02:03:38.419 [info] <0.1045.0> Stopping application 'cowboy'
2025-03-20 02:03:38.422 [info] <0.1045.0> Stopping application 'cowlib'
2025-03-20 02:03:38.422 [info] <0.43.0> Application cowboy exited with reason: stopped
2025-03-20 02:03:38.425 [info] <0.43.0> Application cowlib exited with reason: stopped
2025-03-20 02:03:38.425 [info] <0.1045.0> Stopping application 'rabbitmq_management_agent'
2025-03-20 02:03:38.434 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped
2025-03-20 02:03:38.434 [info] <0.1045.0> Stopping application 'rabbit'
2025-03-20 02:03:38.435 [info] <0.249.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 02:03:38.435 [info] <0.791.0> stopped TCP listener on [::]:5673
2025-03-20 02:03:38.445 [info] <0.444.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2' because the vhost is stopping
2025-03-20 02:03:38.447 [info] <0.463.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent'
2025-03-20 02:03:38.492 [info] <0.463.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped
2025-03-20 02:03:38.492 [info] <0.460.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient'
2025-03-20 02:03:38.505 [info] <0.460.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped
2025-03-20 02:03:38.516 [info] <0.1045.0> Stopping application 'mnesia'
2025-03-20 02:03:38.517 [info] <0.43.0> Application rabbit exited with reason: stopped
2025-03-20 02:03:38.525 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 02:03:38.525 [info] <0.1045.0> Stopping application 'rabbit_common'
2025-03-20 02:03:38.525 [info] <0.43.0> Application rabbit_common exited with reason: stopped
2025-03-20 02:03:38.525 [info] <0.1045.0> Stopping application 'sysmon_handler'
2025-03-20 02:03:38.535 [info] <0.43.0> Application sysmon_handler exited with reason: stopped
2025-03-20 02:03:38.535 [info] <0.1045.0> Stopping application 'os_mon'
2025-03-20 02:03:38.564 [info] <0.43.0> Application os_mon exited with reason: stopped
2025-03-20 02:03:38.564 [info] <0.1045.0> Successfully stopped RabbitMQ and its dependencies
2025-03-20 02:03:49.220 [info] <0.1062.0> Resetting Rabbit forcefully
2025-03-20 02:03:50.186 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 02:03:50.192 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 02:03:50.860 [info] <0.1068.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:03:50.861 [info] <0.1068.0> Successfully synced tables from a peer
2025-03-20 02:03:50.894 [info] <0.1068.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:03:50.894 [info] <0.1068.0> Successfully synced tables from a peer
2025-03-20 02:03:50.934 [info] <0.1068.0> Waiting for Mnesia tables for 30000 ms, 0 retries left
2025-03-20 02:03:50.935 [info] <0.1068.0> Successfully synced tables from a peer
2025-03-20 02:03:50.941 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 02:03:50.967 [info] <0.1068.0> Clustering with ['contrail@cn-jenkins-deploy-platform-ansible-os-2923-3','contrail@cn-jenkins-deploy-platform-ansible-os-2923-1'] as disc node
2025-03-20 02:03:50.993 [info] <0.1068.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:03:50.993 [info] <0.1068.0> Successfully synced tables from a peer
2025-03-20 02:03:51.580 [info] <0.1068.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:03:51.580 [info] <0.1068.0> Successfully synced tables from a peer
2025-03-20 02:03:51.614 [info] <0.1068.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:03:51.615 [info] <0.1068.0> Successfully synced tables from a peer
2025-03-20 02:03:51.621 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 02:03:51.621 [error] <0.1068.0> Failed to create a tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': {node_not_running,'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'}
2025-03-20 02:03:51.621 [info] <0.1068.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 02:03:51.621 [error] <0.1068.0> Failed to create a per-vhost tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': {node_not_running,'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'}
2025-03-20 02:03:51.621 [info] <0.1068.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 02:03:52.843 [info] <0.1429.0> RabbitMQ is asked to stop...
2025-03-20 02:03:52.898 [info] <0.1429.0> Stopping RabbitMQ applications and their dependencies in the following order:
    rabbitmq_management
    amqp_client
    rabbitmq_web_dispatch
    rabbitmq_management_agent
    rabbit
    mnesia
    rabbit_common
    sysmon_handler
    os_mon
2025-03-20 02:03:52.899 [info] <0.1429.0> Stopping application 'rabbitmq_management'
2025-03-20 02:03:52.899 [info] <0.1429.0> Stopping application 'amqp_client'
2025-03-20 02:03:52.899 [info] <0.1429.0> Stopping application 'rabbitmq_web_dispatch'
2025-03-20 02:03:52.899 [info] <0.1429.0> Stopping application 'rabbitmq_management_agent'
2025-03-20 02:03:52.899 [info] <0.1429.0> Stopping application 'rabbit'
2025-03-20 02:03:52.899 [info] <0.1429.0> Stopping application 'mnesia'
2025-03-20 02:03:52.899 [info] <0.1429.0> Stopping application 'rabbit_common'
2025-03-20 02:03:52.899 [info] <0.1429.0> Stopping application 'sysmon_handler'
2025-03-20 02:03:52.899 [info] <0.1429.0> Stopping application 'os_mon'
2025-03-20 02:03:52.899 [info] <0.1429.0> Successfully stopped RabbitMQ and its dependencies
2025-03-20 02:03:52.899 [info] <0.1429.0> Halting Erlang VM with the following applications:
    jsx
    ranch
    ssl
    public_key
    asn1
    stdout_formatter
    inets
    tools
    observer_cli
    recon
    xmerl
    credentials_obfuscation
    crypto
    lager
    goldrush
    compiler
    syntax_tools
    sasl
    stdlib
    kernel
2025-03-20 02:04:02.101 [info] <0.8.0> Log file opened with Lager
2025-03-20 02:04:05.621 [info] <0.8.0> Feature flags: list of feature flags found:
2025-03-20 02:04:05.621 [info] <0.8.0> Feature flags: feature flag states written to disk: yes
2025-03-20 02:04:05.707 [info] <0.8.0> upgrades: Backing up mnesia dir to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2-upgrade-backup"
2025-03-20 02:04:05.710 [info] <0.8.0> upgrades: Mnesia dir backed up to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2-upgrade-backup"
2025-03-20 02:04:05.715 [info] <0.43.0> Application mnesia exited with reason: stopped
2025-03-20 02:04:05.778 [info] <0.296.0> 
 Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21
 Copyright (c) 2007-2020 Pivotal Software, Inc.
 Licensed under the MPL.  See https://www.rabbitmq.com/
2025-03-20 02:04:05.780 [info] <0.296.0> 
 node           : contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
 home dir       : /var/lib/rabbitmq
 config file(s) : /etc/rabbitmq/rabbitmq.config
 cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
 log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
                : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2_upgrade.log
 database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2
2025-03-20 02:04:05.799 [info] <0.296.0> Running boot step pre_boot defined by app rabbit
2025-03-20 02:04:05.799 [info] <0.296.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-03-20 02:04:05.800 [info] <0.296.0> Running boot step rabbit_alarm defined by app rabbit
2025-03-20 02:04:05.813 [info] <0.320.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total
2025-03-20 02:04:05.826 [info] <0.341.0> Enabling free disk space monitoring
2025-03-20 02:04:05.826 [info] <0.341.0> Disk free limit set to 50MB
2025-03-20 02:04:05.841 [info] <0.296.0> Running boot step code_server_cache defined by app rabbit
2025-03-20 02:04:05.841 [info] <0.296.0> Running boot step file_handle_cache defined by app rabbit
2025-03-20 02:04:05.841 [info] <0.366.0> Limiting to approx 65436 file handles (58890 sockets)
2025-03-20 02:04:05.841 [info] <0.367.0> FHC read buffering:  OFF
2025-03-20 02:04:05.841 [info] <0.367.0> FHC write buffering: ON
2025-03-20 02:04:05.842 [info] <0.296.0> Running boot step worker_pool defined by app rabbit
2025-03-20 02:04:05.842 [info] <0.297.0> Will use 4 processes for default worker pool
2025-03-20 02:04:05.842 [info] <0.297.0> Starting worker pool 'worker_pool' with 4 processes in it
2025-03-20 02:04:05.843 [info] <0.296.0> Running boot step database defined by app rabbit
2025-03-20 02:04:05.863 [info] <0.296.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:04:05.866 [info] <0.296.0> Successfully synced tables from a peer
2025-03-20 02:04:05.868 [info] <0.296.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:04:05.868 [info] <0.296.0> Successfully synced tables from a peer
2025-03-20 02:04:05.907 [info] <0.296.0> upgrades: Mnesia backup removed
2025-03-20 02:04:05.907 [info] <0.296.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-03-20 02:04:05.907 [info] <0.296.0> Successfully synced tables from a peer
2025-03-20 02:04:05.907 [info] <0.296.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config
2025-03-20 02:04:05.907 [info] <0.296.0> Running boot step database_sync defined by app rabbit
2025-03-20 02:04:05.907 [info] <0.296.0> Running boot step feature_flags defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step codec_correctness_check defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step external_infrastructure defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step rabbit_registry defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step rabbit_queue_location_random defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step rabbit_event defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2025-03-20 02:04:05.908 [info] <0.296.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step rabbit_priority_queue defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Priority queues enabled, real BQ is rabbit_variable_queue
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step kernel_ready defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2025-03-20 02:04:05.909 [info] <0.296.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2025-03-20 02:04:05.910 [info] <0.407.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2025-03-20 02:04:05.910 [info] <0.296.0> Running boot step guid_generator defined by app rabbit
2025-03-20 02:04:05.915 [info] <0.296.0> Running boot step rabbit_node_monitor defined by app rabbit
2025-03-20 02:04:05.916 [info] <0.411.0> Starting rabbit_node_monitor
2025-03-20 02:04:05.916 [info] <0.296.0> Running boot step delegate_sup defined by app rabbit
2025-03-20 02:04:05.916 [info] <0.296.0> Running boot step rabbit_memory_monitor defined by app rabbit
2025-03-20 02:04:05.916 [info] <0.296.0> Running boot step core_initialized defined by app rabbit
2025-03-20 02:04:05.916 [info] <0.296.0> Running boot step upgrade_queues defined by app rabbit
2025-03-20 02:04:05.940 [info] <0.296.0> message_store upgrades: 1 to apply
2025-03-20 02:04:05.940 [info] <0.296.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2025-03-20 02:04:05.940 [info] <0.296.0> message_store upgrades: No durable queues found. Skipping message store migration
2025-03-20 02:04:05.940 [info] <0.296.0> message_store upgrades: Removing the old message store data
2025-03-20 02:04:05.941 [info] <0.296.0> message_store upgrades: All upgrades applied successfully
2025-03-20 02:04:05.974 [info] <0.296.0> Running boot step rabbit_connection_tracking defined by app rabbit
2025-03-20 02:04:05.974 [info] <0.296.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2025-03-20 02:04:05.974 [info] <0.296.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2025-03-20 02:04:05.974 [info] <0.296.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2025-03-20 02:04:05.975 [info] <0.296.0> Running boot step rabbit_policies defined by app rabbit
2025-03-20 02:04:05.976 [info] <0.296.0> Running boot step rabbit_policy defined by app rabbit
2025-03-20 02:04:05.976 [info] <0.296.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2025-03-20 02:04:05.976 [info] <0.296.0> Running boot step rabbit_vhost_limit defined by app rabbit
2025-03-20 02:04:05.976 [info] <0.296.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2025-03-20 02:04:05.976 [info] <0.296.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2025-03-20 02:04:05.976 [warning] <0.296.0> force_fine_statistics set to true; ignored.
Replaced by {rates_mode, none} in the rabbitmq_management application.
2025-03-20 02:04:05.976 [info] <0.296.0> Management plugin: using rates mode 'basic'
2025-03-20 02:04:05.979 [info] <0.296.0> Running boot step recovery defined by app rabbit
2025-03-20 02:04:05.980 [info] <0.448.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2923-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2025-03-20 02:04:05.986 [info] <0.448.0> Starting message stores for vhost '/'
2025-03-20 02:04:05.986 [info] <0.452.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2025-03-20 02:04:05.987 [info] <0.448.0> Started message store of type transient for vhost '/'
2025-03-20 02:04:05.987 [info] <0.455.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2025-03-20 02:04:05.988 [warning] <0.455.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2025-03-20 02:04:05.988 [info] <0.448.0> Started message store of type persistent for vhost '/'
2025-03-20 02:04:05.990 [info] <0.448.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.474.0>
2025-03-20 02:04:05.990 [info] <0.448.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.478.0>
2025-03-20 02:04:05.991 [info] <0.448.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.482.0>
2025-03-20 02:04:05.991 [info] <0.448.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.486.0>
2025-03-20 02:04:05.991 [info] <0.448.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.490.0>
2025-03-20 02:04:05.992 [info] <0.448.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.494.0>
2025-03-20 02:04:05.992 [info] <0.448.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.498.0>
2025-03-20 02:04:05.992 [info] <0.448.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.502.0>
2025-03-20 02:04:05.992 [info] <0.448.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.506.0>
2025-03-20 02:04:05.993 [info] <0.448.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.510.0>
2025-03-20 02:04:05.993 [info] <0.448.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.514.0>
2025-03-20 02:04:05.993 [info] <0.448.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.518.0>
2025-03-20 02:04:05.993 [info] <0.448.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.522.0>
2025-03-20 02:04:05.994 [info] <0.448.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.526.0>
2025-03-20 02:04:05.994 [info] <0.448.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.530.0>
2025-03-20 02:04:05.994 [info] <0.448.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.534.0>
2025-03-20 02:04:05.994 [info] <0.448.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.538.0>
2025-03-20 02:04:05.995 [info] <0.448.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.542.0>
2025-03-20 02:04:05.995 [info] <0.448.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.546.0>
2025-03-20 02:04:05.995 [info] <0.448.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.550.0>
2025-03-20 02:04:05.996 [info] <0.448.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.554.0>
2025-03-20 02:04:05.996 [info] <0.448.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.558.0>
2025-03-20 02:04:05.996 [info] <0.448.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.562.0>
2025-03-20 02:04:05.996 [info] <0.448.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.566.0>
2025-03-20 02:04:05.997 [info] <0.448.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.570.0>
2025-03-20 02:04:05.997 [info] <0.448.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.574.0>
2025-03-20 02:04:05.997 [info] <0.448.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.578.0>
2025-03-20 02:04:05.997 [info] <0.448.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.582.0>
2025-03-20 02:04:05.998 [info] <0.448.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.586.0>
2025-03-20 02:04:05.998 [info] <0.448.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.590.0>
2025-03-20 02:04:05.998 [info] <0.448.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.594.0>
2025-03-20 02:04:05.998 [info] <0.448.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.598.0>
2025-03-20 02:04:05.998 [info] <0.448.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.602.0>
2025-03-20 02:04:05.999 [info] <0.448.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.606.0>
2025-03-20 02:04:05.999 [info] <0.448.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-1..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.610.0>
2025-03-20 02:04:05.999 [info] <0.448.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.614.0>
2025-03-20 02:04:06.000 [info] <0.448.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-1..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.619.0>
2025-03-20 02:04:06.000 [info] <0.448.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.624.0>
2025-03-20 02:04:06.000 [info] <0.448.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.630.0>
2025-03-20 02:04:06.001 [info] <0.448.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.634.0>
2025-03-20 02:04:06.001 [info] <0.448.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-2': <0.640.0>
2025-03-20 02:04:06.002 [info] <0.296.0> Running boot step load_definitions defined by app rabbitmq_management
2025-03-20 02:04:06.002 [info] <0.296.0> Applying definitions from /etc/rabbitmq/definitions.json
2025-03-20 02:04:06.002 [info] <0.296.0> Asked to import definitions. Acting user: rmq-internal
2025-03-20 02:04:06.002 [info] <0.296.0> Importing users...
2025-03-20 02:04:06.025 [info] <0.296.0> Setting user tags for user 'guest' to [administrator]
2025-03-20 02:04:06.037 [info] <0.296.0> Importing vhosts...
2025-03-20 02:04:06.037 [info] <0.296.0> Importing user permissions...
2025-03-20 02:04:06.037 [info] <0.296.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*'
2025-03-20 02:04:06.064 [info] <0.296.0> Importing topic permissions...
2025-03-20 02:04:06.064 [info] <0.296.0> Importing parameters...
2025-03-20 02:04:06.064 [info] <0.296.0> Importing global parameters...
2025-03-20 02:04:06.064 [info] <0.296.0> Importing policies...
2025-03-20 02:04:06.110 [info] <0.296.0> Importing queues...
2025-03-20 02:04:06.110 [info] <0.296.0> Importing exchanges...
2025-03-20 02:04:06.110 [info] <0.296.0> Importing bindings...
2025-03-20 02:04:06.110 [info] <0.296.0> Running boot step empty_db_check defined by app rabbit
2025-03-20 02:04:06.110 [info] <0.296.0> Running boot step rabbit_looking_glass defined by app rabbit
2025-03-20 02:04:06.110 [info] <0.296.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2025-03-20 02:04:06.110 [info] <0.296.0> Running boot step background_gc defined by app rabbit
2025-03-20 02:04:06.110 [info] <0.296.0> Running boot step connection_tracking defined by app rabbit
2025-03-20 02:04:06.123 [info] <0.296.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 02:04:06.130 [info] <0.296.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2923-2'
2025-03-20 02:04:06.130 [info] <0.296.0> Running boot step routing_ready defined by app rabbit
2025-03-20 02:04:06.130 [info] <0.296.0> Running boot step pre_flight defined by app rabbit
2025-03-20 02:04:06.130 [info] <0.296.0> Running boot step notify_cluster defined by app rabbit
2025-03-20 02:04:06.130 [info] <0.296.0> Running boot step networking defined by app rabbit
2025-03-20 02:04:06.131 [info] <0.411.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-1' up
2025-03-20 02:04:06.132 [info] <0.789.0> started TCP listener on [::]:5673
2025-03-20 02:04:06.133 [info] <0.296.0> Running boot step cluster_name defined by app rabbit
2025-03-20 02:04:06.133 [info] <0.296.0> Running boot step direct_client defined by app rabbit
2025-03-20 02:04:06.133 [info] <0.296.0> Running boot step os_signal_handler defined by app rabbit
2025-03-20 02:04:06.133 [info] <0.791.0> Swapping OS signal event handler (erl_signal_server) for our own
2025-03-20 02:04:06.175 [info] <0.842.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2025-03-20 02:04:06.175 [info] <0.989.0> Statistics database started.
2025-03-20 02:04:06.175 [info] <0.988.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2025-03-20 02:04:06.176 [notice] <0.110.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50
2025-03-20 02:04:06.353 [info] <0.8.0> Server startup complete; 3 plugins started.
 * rabbitmq_management
 * rabbitmq_web_dispatch
 * rabbitmq_management_agent
2025-03-20 02:04:29.859 [info] <0.411.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up
2025-03-20 02:04:47.176 [info] <0.411.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up
2025-03-20 02:04:57.538 [info] <0.411.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' down
2025-03-20 02:04:57.548 [info] <0.411.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2923-3 listeners: the node is already back
2025-03-20 02:04:57.665 [info] <0.510.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.510.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.500.0>
2025-03-20 02:04:57.666 [info] <0.478.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.478.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.468.0>
2025-03-20 02:04:57.667 [info] <0.498.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.498.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.488.0>
2025-03-20 02:04:57.668 [info] <0.490.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.490.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.480.0>
2025-03-20 02:04:57.668 [info] <0.594.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-3..dummy' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.594.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.584.0>
2025-03-20 02:04:57.671 [info] <0.602.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-3..config_queue' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.602.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.592.0>
2025-03-20 02:04:57.674 [info] <0.570.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.570.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.560.0>
2025-03-20 02:04:57.674 [info] <0.506.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.506.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.496.0>
2025-03-20 02:04:57.675 [info] <0.590.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.590.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.580.0>
2025-03-20 02:04:57.683 [info] <0.494.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.494.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.484.0>
2025-03-20 02:04:57.691 [info] <0.586.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-1.-8082-0' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.586.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.576.0>
2025-03-20 02:04:57.707 [info] <0.546.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2923-2' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.546.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.536.0>
2025-03-20 02:04:57.709 [info] <0.486.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-1' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.486.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.476.0>
2025-03-20 02:04:57.710 [info] <0.542.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.542.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.532.0>
2025-03-20 02:04:57.713 [info] <0.554.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.554.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.544.0>
2025-03-20 02:04:57.713 [info] <0.522.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-3.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.522.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.512.0>
2025-03-20 02:04:57.714 [info] <0.566.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2923-3.-8082-0' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.566.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.556.0>
2025-03-20 02:04:57.714 [info] <0.514.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-2..config_queue' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.514.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.504.0>
2025-03-20 02:04:57.716 [info] <0.624.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2923-2.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.624.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.612.0>
2025-03-20 02:04:57.717 [info] <0.610.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2923-1..tftp_queue' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.610.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.600.0>
2025-03-20 02:04:57.718 [info] <0.526.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2923-3' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.526.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.516.0>
2025-03-20 02:04:57.721 [info] <0.538.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2923-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2923-1.' in vhost '/': Slave <contrail@cn-jenkins-deploy-platform-ansible-os-2923-2.3.538.0> saw deaths of mirrors <contrail@cn-jenkins-deploy-platform-ansible-os-2923-3.3.528.0>
2025-03-20 02:04:58.562 [info] <0.411.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' down: connection_closed
2025-03-20 02:05:06.066 [info] <0.411.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up
2025-03-20 02:05:06.561 [info] <0.411.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2923-3' up