2025-10-20 05:03:55.477 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:03:58.542 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:03:58.542 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:03:58.603 [info] <0.238.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:03:58.605 [info] <0.238.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:03:58.618 [info] <0.238.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:03:58.618 [info] <0.238.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:03:58.619 [info] <0.238.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:03:58.627 [info] <0.244.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:03:58.638 [info] <0.246.0> Enabling free disk space monitoring 2025-10-20 05:03:58.638 [info] <0.246.0> Disk free limit set to 50MB 2025-10-20 05:03:58.648 [info] <0.238.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:03:58.648 [info] <0.238.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:03:58.648 [info] <0.249.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:03:58.649 [info] <0.250.0> FHC read buffering: OFF 2025-10-20 05:03:58.649 [info] <0.250.0> FHC write buffering: ON 2025-10-20 05:03:58.650 [info] <0.238.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:03:58.650 [info] <0.239.0> Will use 4 processes for default worker pool 2025-10-20 05:03:58.650 [info] <0.239.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:03:58.650 [info] <0.238.0> Running boot step database defined by app rabbit 2025-10-20 05:03:58.655 [info] <0.238.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2025-10-20 05:03:58.655 [info] <0.238.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2025-10-20 05:03:58.655 [info] <0.238.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2025-10-20 05:03:58.656 [info] <0.238.0> Peer discovery backend does not support locking, falling back to randomized delay 2025-10-20 05:03:58.656 [info] <0.238.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2025-10-20 05:03:58.656 [info] <0.238.0> Will wait for 51754 milliseconds before proceeding with registration... 2025-10-20 05:04:50.411 [info] <0.238.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-4371-1, contrail@cn-jenkins-deploy-platform-ansible-os-4371-2, contrail@cn-jenkins-deploy-platform-ansible-os-4371-3 2025-10-20 05:04:50.411 [info] <0.238.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-4371-2, contrail@cn-jenkins-deploy-platform-ansible-os-4371-3 2025-10-20 05:04:50.411 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-2: {error,tables_not_present} 2025-10-20 05:04:50.412 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-3: {error,tables_not_present} 2025-10-20 05:04:50.413 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2025-10-20 05:04:50.914 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-2: {error,tables_not_present} 2025-10-20 05:04:50.915 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-3: {error,tables_not_present} 2025-10-20 05:04:50.915 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2025-10-20 05:04:51.416 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-2: {error,tables_not_present} 2025-10-20 05:04:51.417 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-3: {error,tables_not_present} 2025-10-20 05:04:51.417 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2025-10-20 05:04:51.918 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-2: {error,tables_not_present} 2025-10-20 05:04:51.919 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-3: {error,tables_not_present} 2025-10-20 05:04:51.919 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2025-10-20 05:04:52.420 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-2: {error,tables_not_present} 2025-10-20 05:04:52.421 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-3: {error,tables_not_present} 2025-10-20 05:04:52.421 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2025-10-20 05:04:52.922 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-2: {error,tables_not_present} 2025-10-20 05:04:52.924 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-3: {error,tables_not_present} 2025-10-20 05:04:52.924 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2025-10-20 05:04:53.428 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-2: {error,tables_not_present} 2025-10-20 05:04:53.432 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-3: {error,tables_not_present} 2025-10-20 05:04:53.432 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2025-10-20 05:04:53.933 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-2: {error,tables_not_present} 2025-10-20 05:04:53.934 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-3: {error,tables_not_present} 2025-10-20 05:04:53.934 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2025-10-20 05:04:54.435 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-2: {error,tables_not_present} 2025-10-20 05:04:54.439 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-4371-3: {error,tables_not_present} 2025-10-20 05:04:54.439 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2025-10-20 05:04:54.942 [info] <0.238.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-4371-2' selected for auto-clustering 2025-10-20 05:04:54.961 [info] <0.238.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-10-20 05:04:54.961 [info] <0.238.0> Successfully synced tables from a peer 2025-10-20 05:04:55.145 [error] <0.237.0> CRASH REPORT Process <0.237.0> with 0 neighbours exited with reason: no match of right hand value {aborted,{system_limit,rabbit_durable_exchange,{'contrail@cn-jenkins-deploy-platform-ansible-os-4371-1',none_active}}} in rabbit_table:create_local_copy/2 line 202 in application_master:init/4 line 138 2025-10-20 05:04:55.145 [info] <0.43.0> Application rabbit exited with reason: no match of right hand value {aborted,{system_limit,rabbit_durable_exchange,{'contrail@cn-jenkins-deploy-platform-ansible-os-4371-1',none_active}}} in rabbit_table:create_local_copy/2 line 202 2025-10-20 05:04:59.714 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:05:02.496 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:05:02.496 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:05:02.562 [info] <0.300.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:05:02.564 [info] <0.300.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:05:02.577 [info] <0.300.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:05:02.577 [info] <0.300.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:05:02.578 [info] <0.300.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:05:02.588 [info] <0.306.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:05:02.592 [info] <0.308.0> Enabling free disk space monitoring 2025-10-20 05:05:02.592 [info] <0.308.0> Disk free limit set to 50MB 2025-10-20 05:05:02.597 [info] <0.300.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:05:02.597 [info] <0.300.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:05:02.597 [info] <0.311.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:05:02.597 [info] <0.312.0> FHC read buffering: OFF 2025-10-20 05:05:02.597 [info] <0.312.0> FHC write buffering: ON 2025-10-20 05:05:02.597 [info] <0.300.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:05:02.597 [info] <0.301.0> Will use 4 processes for default worker pool 2025-10-20 05:05:02.597 [info] <0.301.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:05:02.598 [info] <0.300.0> Running boot step database defined by app rabbit 2025-10-20 05:05:02.599 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-10-20 05:05:03.895 [info] <0.339.0> Removing node 'contrail@cn-jenkins-deploy-platform-ansible-os-4371-2' from cluster 2025-10-20 05:05:32.600 [warning] <0.300.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-10-20 05:05:32.600 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 8 retries left 2025-10-20 05:06:02.601 [warning] <0.300.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-10-20 05:06:02.601 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 7 retries left 2025-10-20 05:06:32.602 [warning] <0.300.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-10-20 05:06:32.602 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 6 retries left 2025-10-20 05:07:02.603 [warning] <0.300.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-10-20 05:07:02.603 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 5 retries left 2025-10-20 05:07:32.604 [warning] <0.300.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-10-20 05:07:32.604 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 4 retries left 2025-10-20 05:08:02.605 [warning] <0.300.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-10-20 05:08:02.605 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 3 retries left 2025-10-20 05:08:32.606 [warning] <0.300.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-10-20 05:08:32.606 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 2 retries left 2025-10-20 05:09:02.607 [warning] <0.300.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-10-20 05:09:02.607 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 1 retries left 2025-10-20 05:09:32.608 [warning] <0.300.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-10-20 05:09:32.608 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 0 retries left 2025-10-20 05:10:02.609 [error] <0.299.0> CRASH REPORT Process <0.299.0> with 0 neighbours exited with reason: {{timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:10:02.610 [info] <0.43.0> Application rabbit exited with reason: {{timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]},{rabbit,start,[normal,[]]}} 2025-10-20 05:10:06.710 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:10:09.359 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:10:09.359 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:10:09.398 [info] <0.285.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:10:09.401 [info] <0.285.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:10:09.417 [info] <0.285.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:10:09.417 [info] <0.285.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:10:09.417 [info] <0.285.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:10:09.424 [info] <0.291.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:10:09.430 [info] <0.293.0> Enabling free disk space monitoring 2025-10-20 05:10:09.430 [info] <0.293.0> Disk free limit set to 50MB 2025-10-20 05:10:09.436 [info] <0.285.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:10:09.437 [info] <0.285.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:10:09.438 [info] <0.296.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:10:09.438 [info] <0.297.0> FHC read buffering: OFF 2025-10-20 05:10:09.438 [info] <0.297.0> FHC write buffering: ON 2025-10-20 05:10:09.438 [info] <0.285.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:10:09.438 [info] <0.286.0> Will use 4 processes for default worker pool 2025-10-20 05:10:09.438 [info] <0.286.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:10:09.439 [info] <0.285.0> Running boot step database defined by app rabbit 2025-10-20 05:10:09.440 [error] <0.284.0> CRASH REPORT Process <0.284.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:10:09.440 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:10:13.925 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:10:17.535 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:10:17.535 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:10:17.641 [info] <0.266.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:10:17.643 [info] <0.266.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:10:17.768 [info] <0.266.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:10:17.773 [info] <0.266.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:10:17.776 [info] <0.266.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:10:17.803 [info] <0.289.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:10:17.812 [info] <0.291.0> Enabling free disk space monitoring 2025-10-20 05:10:17.812 [info] <0.291.0> Disk free limit set to 50MB 2025-10-20 05:10:17.819 [info] <0.266.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:10:17.819 [info] <0.266.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:10:17.820 [info] <0.294.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:10:17.820 [info] <0.295.0> FHC read buffering: OFF 2025-10-20 05:10:17.820 [info] <0.295.0> FHC write buffering: ON 2025-10-20 05:10:17.821 [info] <0.266.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:10:17.821 [info] <0.267.0> Will use 4 processes for default worker pool 2025-10-20 05:10:17.821 [info] <0.267.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:10:17.821 [info] <0.266.0> Running boot step database defined by app rabbit 2025-10-20 05:10:17.830 [error] <0.265.0> CRASH REPORT Process <0.265.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:10:17.831 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:10:23.160 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:10:27.813 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:10:27.814 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:10:27.931 [info] <0.290.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:10:27.937 [info] <0.290.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:10:27.965 [info] <0.290.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:10:27.965 [info] <0.290.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:10:27.965 [info] <0.290.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:10:28.004 [info] <0.306.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:10:28.042 [info] <0.308.0> Enabling free disk space monitoring 2025-10-20 05:10:28.042 [info] <0.308.0> Disk free limit set to 50MB 2025-10-20 05:10:28.053 [info] <0.290.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:10:28.053 [info] <0.290.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:10:28.053 [info] <0.311.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:10:28.054 [info] <0.312.0> FHC read buffering: OFF 2025-10-20 05:10:28.054 [info] <0.312.0> FHC write buffering: ON 2025-10-20 05:10:28.055 [info] <0.290.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:10:28.055 [info] <0.293.0> Will use 4 processes for default worker pool 2025-10-20 05:10:28.055 [info] <0.293.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:10:28.056 [info] <0.290.0> Running boot step database defined by app rabbit 2025-10-20 05:10:28.058 [error] <0.289.0> CRASH REPORT Process <0.289.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:10:28.059 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:10:34.920 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:10:37.076 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:10:37.076 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:10:37.157 [info] <0.283.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:10:37.161 [info] <0.283.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:10:37.175 [info] <0.283.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:10:37.175 [info] <0.283.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:10:37.176 [info] <0.283.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:10:37.184 [info] <0.295.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:10:37.191 [info] <0.297.0> Enabling free disk space monitoring 2025-10-20 05:10:37.191 [info] <0.297.0> Disk free limit set to 50MB 2025-10-20 05:10:37.205 [info] <0.283.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:10:37.205 [info] <0.283.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:10:37.206 [info] <0.300.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:10:37.206 [info] <0.301.0> FHC read buffering: OFF 2025-10-20 05:10:37.206 [info] <0.301.0> FHC write buffering: ON 2025-10-20 05:10:37.208 [info] <0.283.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:10:37.208 [info] <0.290.0> Will use 4 processes for default worker pool 2025-10-20 05:10:37.208 [info] <0.290.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:10:37.209 [info] <0.283.0> Running boot step database defined by app rabbit 2025-10-20 05:10:37.216 [error] <0.282.0> CRASH REPORT Process <0.282.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:10:37.216 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:10:43.062 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:10:45.386 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:10:45.386 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:10:45.444 [info] <0.295.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:10:45.444 [info] <0.295.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:10:45.457 [info] <0.295.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:10:45.457 [info] <0.295.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:10:45.457 [info] <0.295.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:10:45.465 [info] <0.301.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:10:45.472 [info] <0.303.0> Enabling free disk space monitoring 2025-10-20 05:10:45.472 [info] <0.303.0> Disk free limit set to 50MB 2025-10-20 05:10:45.477 [info] <0.295.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:10:45.478 [info] <0.295.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:10:45.478 [info] <0.306.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:10:45.478 [info] <0.307.0> FHC read buffering: OFF 2025-10-20 05:10:45.478 [info] <0.307.0> FHC write buffering: ON 2025-10-20 05:10:45.478 [info] <0.295.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:10:45.478 [info] <0.296.0> Will use 4 processes for default worker pool 2025-10-20 05:10:45.478 [info] <0.296.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:10:45.479 [info] <0.295.0> Running boot step database defined by app rabbit 2025-10-20 05:10:45.480 [error] <0.294.0> CRASH REPORT Process <0.294.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:10:45.481 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:10:52.411 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:10:55.954 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:10:55.955 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:10:56.071 [info] <0.274.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:10:56.073 [info] <0.274.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:10:56.119 [info] <0.274.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:10:56.120 [info] <0.274.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:10:56.122 [info] <0.274.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:10:56.134 [info] <0.300.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:10:56.144 [info] <0.302.0> Enabling free disk space monitoring 2025-10-20 05:10:56.144 [info] <0.302.0> Disk free limit set to 50MB 2025-10-20 05:10:56.153 [info] <0.274.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:10:56.153 [info] <0.274.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:10:56.154 [info] <0.305.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:10:56.154 [info] <0.306.0> FHC read buffering: OFF 2025-10-20 05:10:56.154 [info] <0.306.0> FHC write buffering: ON 2025-10-20 05:10:56.160 [info] <0.274.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:10:56.160 [info] <0.278.0> Will use 4 processes for default worker pool 2025-10-20 05:10:56.160 [info] <0.278.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:10:56.160 [info] <0.274.0> Running boot step database defined by app rabbit 2025-10-20 05:10:56.175 [error] <0.273.0> CRASH REPORT Process <0.273.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:10:56.176 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:11:07.413 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:11:10.224 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:11:10.225 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:11:10.282 [info] <0.298.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:11:10.284 [info] <0.298.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:11:10.318 [info] <0.298.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:11:10.319 [info] <0.298.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:11:10.322 [info] <0.298.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:11:10.344 [info] <0.306.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:11:10.356 [info] <0.308.0> Enabling free disk space monitoring 2025-10-20 05:11:10.356 [info] <0.308.0> Disk free limit set to 50MB 2025-10-20 05:11:10.369 [info] <0.298.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:11:10.370 [info] <0.298.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:11:10.373 [info] <0.312.0> FHC read buffering: OFF 2025-10-20 05:11:10.374 [info] <0.312.0> FHC write buffering: ON 2025-10-20 05:11:10.373 [info] <0.311.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:11:10.376 [info] <0.298.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:11:10.376 [info] <0.301.0> Will use 4 processes for default worker pool 2025-10-20 05:11:10.376 [info] <0.301.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:11:10.377 [info] <0.298.0> Running boot step database defined by app rabbit 2025-10-20 05:11:10.379 [error] <0.297.0> CRASH REPORT Process <0.297.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:11:10.379 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:11:28.477 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:11:33.899 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:11:33.899 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:11:33.999 [info] <0.275.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:11:34.007 [info] <0.275.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:11:34.076 [info] <0.275.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:11:34.078 [info] <0.275.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:11:34.079 [info] <0.275.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:11:34.093 [info] <0.293.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:11:34.108 [info] <0.295.0> Enabling free disk space monitoring 2025-10-20 05:11:34.108 [info] <0.295.0> Disk free limit set to 50MB 2025-10-20 05:11:34.115 [info] <0.275.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:11:34.116 [info] <0.275.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:11:34.117 [info] <0.299.0> FHC read buffering: OFF 2025-10-20 05:11:34.117 [info] <0.299.0> FHC write buffering: ON 2025-10-20 05:11:34.117 [info] <0.298.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:11:34.120 [info] <0.275.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:11:34.120 [info] <0.279.0> Will use 4 processes for default worker pool 2025-10-20 05:11:34.120 [info] <0.279.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:11:34.120 [info] <0.275.0> Running boot step database defined by app rabbit 2025-10-20 05:11:34.121 [error] <0.274.0> CRASH REPORT Process <0.274.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:11:34.122 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:11:39.038 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:11:41.719 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:11:41.719 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:11:41.775 [info] <0.277.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:11:41.779 [info] <0.277.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:11:41.817 [info] <0.277.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:11:41.817 [info] <0.277.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:11:41.824 [info] <0.277.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:11:41.832 [info] <0.300.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:11:41.842 [info] <0.302.0> Enabling free disk space monitoring 2025-10-20 05:11:41.843 [info] <0.302.0> Disk free limit set to 50MB 2025-10-20 05:11:41.854 [info] <0.277.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:11:41.854 [info] <0.277.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:11:41.854 [info] <0.305.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:11:41.854 [info] <0.306.0> FHC read buffering: OFF 2025-10-20 05:11:41.854 [info] <0.306.0> FHC write buffering: ON 2025-10-20 05:11:41.857 [info] <0.277.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:11:41.857 [info] <0.280.0> Will use 4 processes for default worker pool 2025-10-20 05:11:41.857 [info] <0.280.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:11:41.857 [info] <0.277.0> Running boot step database defined by app rabbit 2025-10-20 05:11:41.860 [error] <0.276.0> CRASH REPORT Process <0.276.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:11:41.861 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:11:46.799 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:11:49.393 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:11:49.393 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:11:49.428 [info] <0.293.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:11:49.429 [info] <0.293.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:11:49.441 [info] <0.293.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:11:49.441 [info] <0.293.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:11:49.442 [info] <0.293.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:11:49.452 [info] <0.299.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:11:49.458 [info] <0.301.0> Enabling free disk space monitoring 2025-10-20 05:11:49.458 [info] <0.301.0> Disk free limit set to 50MB 2025-10-20 05:11:49.463 [info] <0.293.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:11:49.463 [info] <0.293.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:11:49.463 [info] <0.304.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:11:49.463 [info] <0.305.0> FHC read buffering: OFF 2025-10-20 05:11:49.463 [info] <0.305.0> FHC write buffering: ON 2025-10-20 05:11:49.464 [info] <0.293.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:11:49.464 [info] <0.294.0> Will use 4 processes for default worker pool 2025-10-20 05:11:49.464 [info] <0.294.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:11:49.464 [info] <0.293.0> Running boot step database defined by app rabbit 2025-10-20 05:11:49.465 [error] <0.292.0> CRASH REPORT Process <0.292.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:11:49.466 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:11:53.370 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:11:55.631 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:11:55.631 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:11:55.689 [info] <0.285.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:11:55.690 [info] <0.285.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:11:55.706 [info] <0.285.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:11:55.706 [info] <0.285.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:11:55.707 [info] <0.285.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:11:55.717 [info] <0.291.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:11:55.725 [info] <0.293.0> Enabling free disk space monitoring 2025-10-20 05:11:55.725 [info] <0.293.0> Disk free limit set to 50MB 2025-10-20 05:11:55.733 [info] <0.285.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:11:55.733 [info] <0.285.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:11:55.733 [info] <0.296.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:11:55.733 [info] <0.297.0> FHC read buffering: OFF 2025-10-20 05:11:55.733 [info] <0.297.0> FHC write buffering: ON 2025-10-20 05:11:55.739 [info] <0.285.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:11:55.739 [info] <0.286.0> Will use 4 processes for default worker pool 2025-10-20 05:11:55.739 [info] <0.286.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:11:55.740 [info] <0.285.0> Running boot step database defined by app rabbit 2025-10-20 05:11:55.742 [error] <0.284.0> CRASH REPORT Process <0.284.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:11:55.742 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:12:00.294 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:12:02.084 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:12:02.084 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:12:02.132 [info] <0.289.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:12:02.133 [info] <0.289.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:12:02.146 [info] <0.289.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:12:02.146 [info] <0.289.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:12:02.147 [info] <0.289.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:12:02.155 [info] <0.301.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:12:02.171 [info] <0.303.0> Enabling free disk space monitoring 2025-10-20 05:12:02.171 [info] <0.303.0> Disk free limit set to 50MB 2025-10-20 05:12:02.180 [info] <0.289.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:12:02.180 [info] <0.289.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:12:02.180 [info] <0.307.0> FHC read buffering: OFF 2025-10-20 05:12:02.180 [info] <0.307.0> FHC write buffering: ON 2025-10-20 05:12:02.181 [info] <0.289.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:12:02.181 [info] <0.292.0> Will use 4 processes for default worker pool 2025-10-20 05:12:02.181 [info] <0.292.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:12:02.181 [info] <0.306.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:12:02.182 [info] <0.289.0> Running boot step database defined by app rabbit 2025-10-20 05:12:02.186 [error] <0.288.0> CRASH REPORT Process <0.288.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:12:02.189 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:12:07.266 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:12:09.802 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:12:09.802 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:12:09.865 [info] <0.283.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:12:09.869 [info] <0.283.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:12:09.883 [info] <0.283.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:12:09.883 [info] <0.283.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:12:09.884 [info] <0.283.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:12:09.891 [info] <0.304.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:12:09.905 [info] <0.306.0> Enabling free disk space monitoring 2025-10-20 05:12:09.906 [info] <0.306.0> Disk free limit set to 50MB 2025-10-20 05:12:09.910 [info] <0.283.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:12:09.910 [info] <0.283.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:12:09.910 [info] <0.309.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:12:09.910 [info] <0.310.0> FHC read buffering: OFF 2025-10-20 05:12:09.910 [info] <0.310.0> FHC write buffering: ON 2025-10-20 05:12:09.911 [info] <0.283.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:12:09.911 [info] <0.284.0> Will use 4 processes for default worker pool 2025-10-20 05:12:09.912 [info] <0.284.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:12:09.912 [info] <0.283.0> Running boot step database defined by app rabbit 2025-10-20 05:12:09.914 [error] <0.282.0> CRASH REPORT Process <0.282.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:12:09.914 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:12:16.617 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:12:18.683 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:12:18.683 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:12:18.729 [info] <0.280.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:12:18.730 [info] <0.280.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:12:18.745 [info] <0.280.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:12:18.745 [info] <0.280.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:12:18.746 [info] <0.280.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:12:18.757 [info] <0.303.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:12:18.764 [info] <0.305.0> Enabling free disk space monitoring 2025-10-20 05:12:18.764 [info] <0.305.0> Disk free limit set to 50MB 2025-10-20 05:12:18.768 [info] <0.280.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:12:18.768 [info] <0.280.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:12:18.768 [info] <0.308.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:12:18.771 [info] <0.309.0> FHC read buffering: OFF 2025-10-20 05:12:18.771 [info] <0.309.0> FHC write buffering: ON 2025-10-20 05:12:18.771 [info] <0.280.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:12:18.771 [info] <0.281.0> Will use 4 processes for default worker pool 2025-10-20 05:12:18.771 [info] <0.281.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:12:18.772 [info] <0.280.0> Running boot step database defined by app rabbit 2025-10-20 05:12:18.774 [error] <0.279.0> CRASH REPORT Process <0.279.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:12:18.774 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:12:29.086 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:12:33.482 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:12:33.483 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:12:33.883 [error] <0.163.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-4371-1'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_1760_937153_882283") ** FATAL ** Failed to merge schema: Bad cookie in table definition rabbit_topic_trie_binding: 'contrail@cn-jenkins-deploy-platform-ansible-os-4371-1' = {cstruct,rabbit_topic_trie_binding,ordered_set,['contrail@cn-jenkins-deploy-platform-ansible-os-4371-1'],[],[],[],0,read_write,false,[],[],false,topic_trie_binding,[trie_binding,value],[],[],[],{{1760936694524366637,-576460752303421535,1},'contrail@cn-jenkins-deploy-platform-ansible-os-4371-2'},{{3,2},{'contrail@cn-jenkins-deploy-platform-ansible-os-4371-1',{1760,936703,896353}}}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-4371-3' = {cstruct,rabbit_topic_trie_binding,ordered_set,['contrail@cn-jenkins-deploy-platform-ansible-os-4371-3'],[],[],[],0,read_write,false,[],[],false,topic_trie_binding,[trie_binding,value],[],[],[],{{1760937142466582503,-576460752303420383,1},'contrail@cn-jenkins-deploy-platform-ansible-os-4371-3'},{{2,0},[]}} 2025-10-20 05:12:43.883 [error] <0.162.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-10-20 05:12:43.884 [error] <0.167.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.165.0>,killed} ** When Server state == {state,<0.165.0>,#Ref<0.3653483828.3351904257.75942>} ** Reason for termination == ** killed 2025-10-20 05:12:43.884 [error] <0.167.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-10-20 05:12:43.884 [error] <0.166.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.165.0>,killed} ** When Server state == {state,<0.165.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-10-20 05:12:43.884 [error] <0.166.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-10-20 05:12:43.884 [error] <0.169.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.165.0>,killed} ** When Server state == {state,<0.165.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-10-20 05:12:43.884 [error] <0.169.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-10-20 05:12:43.884 [error] <0.160.0> CRASH REPORT Process <0.160.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:12:43.884 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-10-20 05:12:43.885 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log 2025-10-20 05:12:48.089 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:12:50.722 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:12:50.722 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:12:50.778 [info] <0.266.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:12:50.779 [info] <0.266.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:12:50.797 [info] <0.266.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:12:50.797 [info] <0.266.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:12:50.797 [info] <0.266.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:12:50.816 [info] <0.287.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:12:50.834 [info] <0.289.0> Enabling free disk space monitoring 2025-10-20 05:12:50.835 [info] <0.289.0> Disk free limit set to 50MB 2025-10-20 05:12:50.845 [info] <0.266.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:12:50.845 [info] <0.266.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:12:50.845 [info] <0.292.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:12:50.845 [info] <0.293.0> FHC read buffering: OFF 2025-10-20 05:12:50.845 [info] <0.293.0> FHC write buffering: ON 2025-10-20 05:12:50.846 [info] <0.266.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:12:50.846 [info] <0.267.0> Will use 4 processes for default worker pool 2025-10-20 05:12:50.846 [info] <0.267.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:12:50.846 [info] <0.266.0> Running boot step database defined by app rabbit 2025-10-20 05:12:50.850 [error] <0.265.0> CRASH REPORT Process <0.265.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:12:50.850 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:12:54.453 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:12:57.200 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:12:57.200 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:12:57.248 [info] <0.296.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:12:57.250 [info] <0.296.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:12:57.262 [info] <0.296.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:12:57.262 [info] <0.296.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:12:57.263 [info] <0.296.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:12:57.272 [info] <0.302.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:12:57.279 [info] <0.304.0> Enabling free disk space monitoring 2025-10-20 05:12:57.279 [info] <0.304.0> Disk free limit set to 50MB 2025-10-20 05:12:57.285 [info] <0.296.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:12:57.285 [info] <0.296.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:12:57.285 [info] <0.308.0> FHC read buffering: OFF 2025-10-20 05:12:57.285 [info] <0.308.0> FHC write buffering: ON 2025-10-20 05:12:57.285 [info] <0.307.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:12:57.285 [info] <0.296.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:12:57.286 [info] <0.297.0> Will use 4 processes for default worker pool 2025-10-20 05:12:57.286 [info] <0.297.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:12:57.286 [info] <0.296.0> Running boot step database defined by app rabbit 2025-10-20 05:12:57.294 [error] <0.295.0> CRASH REPORT Process <0.295.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:12:57.295 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:13:01.465 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:13:03.268 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:13:03.268 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:13:03.356 [info] <0.283.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:13:03.358 [info] <0.283.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:13:03.373 [info] <0.283.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:13:03.373 [info] <0.283.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:13:03.373 [info] <0.283.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:13:03.378 [info] <0.299.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:13:03.383 [info] <0.301.0> Enabling free disk space monitoring 2025-10-20 05:13:03.383 [info] <0.301.0> Disk free limit set to 50MB 2025-10-20 05:13:03.393 [info] <0.283.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:13:03.393 [info] <0.283.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:13:03.394 [info] <0.304.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:13:03.394 [info] <0.305.0> FHC read buffering: OFF 2025-10-20 05:13:03.394 [info] <0.305.0> FHC write buffering: ON 2025-10-20 05:13:03.394 [info] <0.283.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:13:03.394 [info] <0.294.0> Will use 4 processes for default worker pool 2025-10-20 05:13:03.394 [info] <0.294.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:13:03.394 [info] <0.283.0> Running boot step database defined by app rabbit 2025-10-20 05:13:03.397 [error] <0.282.0> CRASH REPORT Process <0.282.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:13:03.399 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:13:07.617 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:13:09.210 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:13:09.210 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:13:09.255 [info] <0.288.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:13:09.256 [info] <0.288.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:13:09.270 [info] <0.288.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:13:09.270 [info] <0.288.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:13:09.270 [info] <0.288.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:13:09.275 [info] <0.294.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:13:09.281 [info] <0.296.0> Enabling free disk space monitoring 2025-10-20 05:13:09.281 [info] <0.296.0> Disk free limit set to 50MB 2025-10-20 05:13:09.286 [info] <0.288.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:13:09.286 [info] <0.288.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:13:09.286 [info] <0.299.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:13:09.286 [info] <0.300.0> FHC read buffering: OFF 2025-10-20 05:13:09.286 [info] <0.300.0> FHC write buffering: ON 2025-10-20 05:13:09.286 [info] <0.288.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:13:09.286 [info] <0.289.0> Will use 4 processes for default worker pool 2025-10-20 05:13:09.286 [info] <0.289.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:13:09.287 [info] <0.288.0> Running boot step database defined by app rabbit 2025-10-20 05:13:09.288 [error] <0.287.0> CRASH REPORT Process <0.287.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:13:09.288 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:13:14.407 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:13:16.140 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:13:16.140 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:13:16.174 [info] <0.287.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:13:16.175 [info] <0.287.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:13:16.189 [info] <0.287.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:13:16.189 [info] <0.287.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:13:16.190 [info] <0.287.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:13:16.194 [info] <0.293.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:13:16.198 [info] <0.295.0> Enabling free disk space monitoring 2025-10-20 05:13:16.199 [info] <0.295.0> Disk free limit set to 50MB 2025-10-20 05:13:16.202 [info] <0.287.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:13:16.202 [info] <0.287.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:13:16.203 [info] <0.298.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:13:16.203 [info] <0.299.0> FHC read buffering: OFF 2025-10-20 05:13:16.203 [info] <0.299.0> FHC write buffering: ON 2025-10-20 05:13:16.203 [info] <0.287.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:13:16.203 [info] <0.288.0> Will use 4 processes for default worker pool 2025-10-20 05:13:16.203 [info] <0.288.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:13:16.203 [info] <0.287.0> Running boot step database defined by app rabbit 2025-10-20 05:13:16.205 [error] <0.286.0> CRASH REPORT Process <0.286.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:13:16.205 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:13:23.619 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:13:26.170 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:13:26.170 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:13:26.207 [info] <0.289.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:13:26.208 [info] <0.289.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:13:26.220 [info] <0.289.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:13:26.220 [info] <0.289.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:13:26.220 [info] <0.289.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:13:26.225 [info] <0.295.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:13:26.230 [info] <0.297.0> Enabling free disk space monitoring 2025-10-20 05:13:26.230 [info] <0.297.0> Disk free limit set to 50MB 2025-10-20 05:13:26.235 [info] <0.289.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:13:26.235 [info] <0.289.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:13:26.235 [info] <0.300.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:13:26.235 [info] <0.301.0> FHC read buffering: OFF 2025-10-20 05:13:26.235 [info] <0.301.0> FHC write buffering: ON 2025-10-20 05:13:26.236 [info] <0.289.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:13:26.236 [info] <0.290.0> Will use 4 processes for default worker pool 2025-10-20 05:13:26.236 [info] <0.290.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:13:26.236 [info] <0.289.0> Running boot step database defined by app rabbit 2025-10-20 05:13:26.238 [error] <0.288.0> CRASH REPORT Process <0.288.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:13:26.239 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:13:36.373 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:13:38.926 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:13:38.926 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:13:38.966 [info] <0.287.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:13:38.967 [info] <0.287.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:13:38.981 [info] <0.287.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:13:38.981 [info] <0.287.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:13:38.981 [info] <0.287.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:13:38.993 [info] <0.293.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:13:39.000 [info] <0.295.0> Enabling free disk space monitoring 2025-10-20 05:13:39.000 [info] <0.295.0> Disk free limit set to 50MB 2025-10-20 05:13:39.005 [info] <0.287.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:13:39.005 [info] <0.287.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:13:39.005 [info] <0.298.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:13:39.005 [info] <0.299.0> FHC read buffering: OFF 2025-10-20 05:13:39.005 [info] <0.299.0> FHC write buffering: ON 2025-10-20 05:13:39.005 [info] <0.287.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:13:39.005 [info] <0.288.0> Will use 4 processes for default worker pool 2025-10-20 05:13:39.005 [info] <0.288.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:13:39.006 [info] <0.287.0> Running boot step database defined by app rabbit 2025-10-20 05:13:39.012 [error] <0.286.0> CRASH REPORT Process <0.286.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:13:39.013 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:13:56.281 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:13:59.577 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:13:59.578 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:13:59.651 [info] <0.276.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:13:59.653 [info] <0.276.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:13:59.670 [info] <0.276.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:13:59.670 [info] <0.276.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:13:59.670 [info] <0.276.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:13:59.676 [info] <0.297.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:13:59.681 [info] <0.299.0> Enabling free disk space monitoring 2025-10-20 05:13:59.681 [info] <0.299.0> Disk free limit set to 50MB 2025-10-20 05:13:59.685 [info] <0.276.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:13:59.685 [info] <0.276.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:13:59.685 [info] <0.302.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:13:59.686 [info] <0.303.0> FHC read buffering: OFF 2025-10-20 05:13:59.686 [info] <0.303.0> FHC write buffering: ON 2025-10-20 05:13:59.686 [info] <0.276.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:13:59.686 [info] <0.278.0> Will use 4 processes for default worker pool 2025-10-20 05:13:59.686 [info] <0.278.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:13:59.686 [info] <0.276.0> Running boot step database defined by app rabbit 2025-10-20 05:13:59.689 [error] <0.275.0> CRASH REPORT Process <0.275.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:13:59.689 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:14:29.584 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:14:32.940 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:14:32.940 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:14:33.002 [info] <0.281.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:14:33.003 [info] <0.281.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:14:33.017 [info] <0.281.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:14:33.018 [info] <0.281.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:14:33.018 [info] <0.281.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:14:33.023 [info] <0.300.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:14:33.038 [info] <0.302.0> Enabling free disk space monitoring 2025-10-20 05:14:33.038 [info] <0.302.0> Disk free limit set to 50MB 2025-10-20 05:14:33.044 [info] <0.281.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:14:33.044 [info] <0.281.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:14:33.045 [info] <0.306.0> FHC read buffering: OFF 2025-10-20 05:14:33.045 [info] <0.306.0> FHC write buffering: ON 2025-10-20 05:14:33.045 [info] <0.305.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:14:33.046 [info] <0.281.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:14:33.046 [info] <0.284.0> Will use 4 processes for default worker pool 2025-10-20 05:14:33.046 [info] <0.284.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:14:33.046 [info] <0.281.0> Running boot step database defined by app rabbit 2025-10-20 05:14:33.049 [error] <0.280.0> CRASH REPORT Process <0.280.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:14:33.049 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:15:28.156 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:15:31.567 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:15:31.567 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:15:31.610 [info] <0.289.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:15:31.611 [info] <0.289.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:15:31.623 [info] <0.289.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:15:31.623 [info] <0.289.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:15:31.623 [info] <0.289.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:15:31.630 [info] <0.295.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:15:31.635 [info] <0.297.0> Enabling free disk space monitoring 2025-10-20 05:15:31.635 [info] <0.297.0> Disk free limit set to 50MB 2025-10-20 05:15:31.639 [info] <0.289.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:15:31.639 [info] <0.289.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:15:31.639 [info] <0.300.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:15:31.639 [info] <0.301.0> FHC read buffering: OFF 2025-10-20 05:15:31.639 [info] <0.301.0> FHC write buffering: ON 2025-10-20 05:15:31.639 [info] <0.289.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:15:31.640 [info] <0.290.0> Will use 4 processes for default worker pool 2025-10-20 05:15:31.640 [info] <0.290.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:15:31.640 [info] <0.289.0> Running boot step database defined by app rabbit 2025-10-20 05:15:31.641 [error] <0.288.0> CRASH REPORT Process <0.288.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:15:31.641 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:16:35.001 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:16:37.463 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:16:37.464 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:16:37.572 [info] <0.289.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:16:37.573 [info] <0.289.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:16:37.620 [info] <0.289.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:16:37.620 [info] <0.289.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:16:37.620 [info] <0.289.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:16:37.641 [info] <0.295.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:16:37.653 [info] <0.297.0> Enabling free disk space monitoring 2025-10-20 05:16:37.654 [info] <0.297.0> Disk free limit set to 50MB 2025-10-20 05:16:37.663 [info] <0.289.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:16:37.663 [info] <0.289.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:16:37.663 [info] <0.301.0> FHC read buffering: OFF 2025-10-20 05:16:37.664 [info] <0.301.0> FHC write buffering: ON 2025-10-20 05:16:37.663 [info] <0.300.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:16:37.666 [info] <0.289.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:16:37.666 [info] <0.290.0> Will use 4 processes for default worker pool 2025-10-20 05:16:37.666 [info] <0.290.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:16:37.666 [info] <0.289.0> Running boot step database defined by app rabbit 2025-10-20 05:16:37.670 [error] <0.288.0> CRASH REPORT Process <0.288.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:16:37.670 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:17:41.102 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:17:42.874 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:17:42.874 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:17:43.095 [info] <0.291.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:17:43.096 [info] <0.291.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:17:43.115 [info] <0.291.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:17:43.115 [info] <0.291.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:17:43.116 [info] <0.291.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:17:43.124 [info] <0.297.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:17:43.133 [info] <0.299.0> Enabling free disk space monitoring 2025-10-20 05:17:43.133 [info] <0.299.0> Disk free limit set to 50MB 2025-10-20 05:17:43.139 [info] <0.291.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:17:43.139 [info] <0.291.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:17:43.140 [info] <0.302.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:17:43.141 [info] <0.303.0> FHC read buffering: OFF 2025-10-20 05:17:43.141 [info] <0.303.0> FHC write buffering: ON 2025-10-20 05:17:43.141 [info] <0.291.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:17:43.141 [info] <0.292.0> Will use 4 processes for default worker pool 2025-10-20 05:17:43.141 [info] <0.292.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:17:43.142 [info] <0.291.0> Running boot step database defined by app rabbit 2025-10-20 05:17:43.143 [error] <0.290.0> CRASH REPORT Process <0.290.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:17:43.143 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:18:46.697 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:18:48.305 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:18:48.305 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:18:48.349 [info] <0.291.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:18:48.350 [info] <0.291.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:18:48.362 [info] <0.291.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:18:48.362 [info] <0.291.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:18:48.363 [info] <0.291.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:18:48.374 [info] <0.297.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:18:48.378 [info] <0.299.0> Enabling free disk space monitoring 2025-10-20 05:18:48.378 [info] <0.299.0> Disk free limit set to 50MB 2025-10-20 05:18:48.382 [info] <0.291.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:18:48.383 [info] <0.291.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:18:48.383 [info] <0.302.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:18:48.383 [info] <0.303.0> FHC read buffering: OFF 2025-10-20 05:18:48.383 [info] <0.303.0> FHC write buffering: ON 2025-10-20 05:18:48.383 [info] <0.291.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:18:48.383 [info] <0.292.0> Will use 4 processes for default worker pool 2025-10-20 05:18:48.383 [info] <0.292.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:18:48.383 [info] <0.291.0> Running boot step database defined by app rabbit 2025-10-20 05:18:48.385 [error] <0.290.0> CRASH REPORT Process <0.290.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:18:48.385 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:19:51.767 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:19:53.471 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:19:53.471 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:19:53.509 [info] <0.289.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:19:53.509 [info] <0.289.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:19:53.522 [info] <0.289.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:19:53.522 [info] <0.289.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:19:53.522 [info] <0.289.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:19:53.528 [info] <0.295.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:19:53.533 [info] <0.297.0> Enabling free disk space monitoring 2025-10-20 05:19:53.533 [info] <0.297.0> Disk free limit set to 50MB 2025-10-20 05:19:53.538 [info] <0.289.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:19:53.538 [info] <0.289.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:19:53.538 [info] <0.300.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:19:53.538 [info] <0.301.0> FHC read buffering: OFF 2025-10-20 05:19:53.538 [info] <0.301.0> FHC write buffering: ON 2025-10-20 05:19:53.538 [info] <0.289.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:19:53.538 [info] <0.290.0> Will use 4 processes for default worker pool 2025-10-20 05:19:53.538 [info] <0.290.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:19:53.539 [info] <0.289.0> Running boot step database defined by app rabbit 2025-10-20 05:19:53.541 [error] <0.288.0> CRASH REPORT Process <0.288.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:19:53.541 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:20:57.546 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:20:59.668 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:20:59.668 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:20:59.714 [info] <0.278.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:20:59.715 [info] <0.278.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:20:59.729 [info] <0.278.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:20:59.730 [info] <0.278.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:20:59.730 [info] <0.278.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:20:59.737 [info] <0.299.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:20:59.745 [info] <0.301.0> Enabling free disk space monitoring 2025-10-20 05:20:59.745 [info] <0.301.0> Disk free limit set to 50MB 2025-10-20 05:20:59.750 [info] <0.278.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:20:59.750 [info] <0.278.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:20:59.751 [info] <0.304.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:20:59.751 [info] <0.305.0> FHC read buffering: OFF 2025-10-20 05:20:59.751 [info] <0.305.0> FHC write buffering: ON 2025-10-20 05:20:59.751 [info] <0.278.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:20:59.751 [info] <0.279.0> Will use 4 processes for default worker pool 2025-10-20 05:20:59.751 [info] <0.279.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:20:59.751 [info] <0.278.0> Running boot step database defined by app rabbit 2025-10-20 05:20:59.752 [error] <0.277.0> CRASH REPORT Process <0.277.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:20:59.752 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} 2025-10-20 05:22:03.063 [info] <0.8.0> Log file opened with Lager 2025-10-20 05:22:05.019 [info] <0.8.0> Feature flags: list of feature flags found: 2025-10-20 05:22:05.019 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-10-20 05:22:05.061 [info] <0.274.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-10-20 05:22:05.062 [info] <0.274.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-4371-1 2025-10-20 05:22:05.078 [info] <0.274.0> Running boot step pre_boot defined by app rabbit 2025-10-20 05:22:05.078 [info] <0.274.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-20 05:22:05.079 [info] <0.274.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-20 05:22:05.085 [info] <0.295.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total 2025-10-20 05:22:05.090 [info] <0.297.0> Enabling free disk space monitoring 2025-10-20 05:22:05.090 [info] <0.297.0> Disk free limit set to 50MB 2025-10-20 05:22:05.096 [info] <0.274.0> Running boot step code_server_cache defined by app rabbit 2025-10-20 05:22:05.096 [info] <0.274.0> Running boot step file_handle_cache defined by app rabbit 2025-10-20 05:22:05.096 [info] <0.300.0> Limiting to approx 65436 file handles (58890 sockets) 2025-10-20 05:22:05.096 [info] <0.301.0> FHC read buffering: OFF 2025-10-20 05:22:05.096 [info] <0.301.0> FHC write buffering: ON 2025-10-20 05:22:05.096 [info] <0.274.0> Running boot step worker_pool defined by app rabbit 2025-10-20 05:22:05.096 [info] <0.276.0> Will use 4 processes for default worker pool 2025-10-20 05:22:05.096 [info] <0.276.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-10-20 05:22:05.097 [info] <0.274.0> Running boot step database defined by app rabbit 2025-10-20 05:22:05.098 [error] <0.273.0> CRASH REPORT Process <0.273.0> with 0 neighbours exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-10-20 05:22:05.098 [info] <0.43.0> Application rabbit exited with reason: {{schema_integrity_check_failed,[{table_missing,rabbit_durable_exchange},{table_missing,rabbit_exchange},{table_missing,rabbit_exchange_serial},{table_missing,rabbit_runtime_parameters},{table_missing,rabbit_durable_queue},{table_missing,rabbit_queue},{table_missing,gm_group},{table_missing,mirrored_sup_childspec}]},{rabbit,start,[normal,[]]}}