2025-03-24 Mon 00:49:26:306.502 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-03-20 00:12:26.938346","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-8222-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-03-24 Mon 00:49:26:306.703 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: ROLE : Generator 2025-03-24 Mon 00:49:26:306.717 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: MODULE : contrail-dns 2025-03-24 Mon 00:49:26:306.725 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-2938-3 2025-03-24 Mon 00:49:26:306.732 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: NODE TYPE : Control 2025-03-24 Mon 00:49:26:306.739 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: INSTANCE ID : 0 2025-03-24 Mon 00:49:26:306.747 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: HTTP SERVER PORT : 8092 2025-03-24 Mon 00:49:26:306.762 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-03-24 Mon 00:49:26:307.104 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: HTTP Introspect Init 2025-03-24 Mon 00:49:26:307.257 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-03-24 Mon 00:49:26:307.328 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: Sandesh Http Server Port: 8092 2025-03-24 Mon 00:49:26:307.388 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.27251.http_port 2025-03-24 Mon 00:49:26:307.400 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: CONNECT TO COLLECTOR: 1 2025-03-24 Mon 00:49:26:307.519 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: Idle 2025-03-24 Mon 00:49:26:307.788 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: No Client: 1742777366307643 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:26:307.952 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: Logging: DISABLED -> ENABLED 2025-03-24 Mon 00:49:26:307.972 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-03-24 Mon 00:49:26:311.676 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvStart in state Idle 2025-03-24 Mon 00:49:26:311.791 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Disconnect 2025-03-24 Mon 00:49:26:311.900 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvCollectorUpdate in state Disconnect 2025-03-24 Mon 00:49:26:312.141 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Connect : Start Connect timer 10.0.0.23:8086 2025-03-24 Mon 00:49:26:312.244 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:26:312.380 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: SANDESH: Send FAILED: 1742777366311880 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:26:312.404 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:26:312.419 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:26:312.537 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: SANDESH: Send FAILED: 1742777366311971 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.23:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:26:312.551 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:26:312.568 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:26:312.677 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: SANDESH: Send FAILED: 1742777366312230 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.23:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:26:312.690 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:26:490.591 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.21:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-03-24 Mon 00:49:26:490.732 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 380 2025-03-24 Mon 00:49:26:490.841 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 295 2025-03-24 Mon 00:49:26:491.322 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 159 2025-03-24 Mon 00:49:26:491.346 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 168 2025-03-24 Mon 00:49:26:491.347 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:26:491.627 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: SANDESH: Send FAILED: 1742777366491284 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.23:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-03-24 Mon 00:49:26:491.638 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:26:687.663 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 152 2025-03-24 Mon 00:49:26:687.817 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 300 2025-03-24 Mon 00:49:26:687.868 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 578 2025-03-24 Mon 00:49:26:687.878 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 85 2025-03-24 Mon 00:49:26:687.709 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:26:688.995 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: SANDESH: Send FAILED: 1742777366687611 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.23:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-03-24 Mon 00:49:26:689.013 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:26:689.041 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:26:689.069 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: SANDESH: Send FAILED: 1742777366687860 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.23:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-03-24 Mon 00:49:26:689.079 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:26:719.087 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 93 2025-03-24 Mon 00:49:26:719.769 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 102 2025-03-24 Mon 00:49:26:719.822 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 108 2025-03-24 Mon 00:49:26:719.909 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:719.925 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 391 2025-03-24 Mon 00:49:26:720.060 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:26:720.120 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SANDESH: Send FAILED: 1742777366719877 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.23:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:26:720.139 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:26:721.584 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:723.987 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:726.271 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:728.020 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:733.491 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:734.932 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:740.713 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:748.054 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:751.123 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:753.875 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:802.581 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:830.717 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:841.446 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:852.225 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:854.237 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:855.902 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:858.100 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:865.240 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:866.710 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:870.551 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:874.582 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:877.895 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:880.219 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:882.953 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:885.485 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:887.748 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:893.405 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:895.015 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:896.270 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:897.810 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:899.250 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:900.807 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:903.222 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:905.189 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:911.486 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:915.918 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:919.670 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:922.819 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:927.091 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:928.474 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:934.632 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:939.919 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:941.313 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:944.529 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:946.448 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:949.819 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:953.551 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:967.305 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:26:969.523 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:050.904 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:052.834 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:065.165 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:084.123 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:100.027 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:106.582 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:110.821 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:112.468 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:113.686 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:116.281 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:118.821 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:120.070 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:121.120 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:122.289 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:124.032 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:131.635 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:133.378 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:145.443 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:147.012 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:150.805 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:153.143 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:155.570 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:157.696 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:159.182 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:163.548 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:165.489 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:169.101 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:170.435 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:173.541 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:181.723 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:184.987 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:188.026 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:194.890 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:199.086 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:201.569 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:205.368 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:208.572 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:210.342 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:212.027 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:214.840 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:217.548 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:220.336 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:223.208 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:224.997 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:227.178 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:233.918 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:237.681 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:241.154 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:244.798 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:247.291 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:252.913 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:254.456 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:259.621 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:265.501 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:267.361 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:269.188 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:271.236 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:275.507 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:280.338 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:284.049 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:290.065 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:292.162 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:293.835 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:302.854 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:304.763 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:308.467 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:312.738 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:314.560 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:320.447 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:323.221 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-03-24 Mon 00:49:27:323.258 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262295508736, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-03-24 Mon 00:49:27:323.244 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-03-24 Mon 00:49:27:323.259 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-03-24 Mon 00:49:27:323.527 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-03-24 Mon 00:49:27:323.645 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 552 2025-03-24 Mon 00:49:27:323.688 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 191 2025-03-24 Mon 00:49:27:323.716 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 219 2025-03-24 Mon 00:49:27:323.913 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:27:323.953 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: SANDESH: Send FAILED: 1742777367323736 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.23:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:27:323.971 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:27:324.012 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-03-24 Mon 00:49:27:323.243 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-03-24 Mon 00:49:27:337.460 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:337.826 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 12beb160-fb58-4594-a3c5-e01bdc4f59ab controller/src/ifmap/client/config_json_parser.cc 217 2025-03-24 Mon 00:49:27:338.065 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 4008c21b-1574-4053-add1-15fb952eed1b controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:27:338.635 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance a19e55d2-5586-4a3b-aeea-26b51c50011a controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:27:339.233 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.265 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.306 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.324 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.340 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:pnf-service-chaining controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.361 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.374 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:pnf-servicechain controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.384 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.396 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.406 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.417 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.433 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.444 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-mx controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.461 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.475 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.487 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx960 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.497 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.509 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2020 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.518 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.530 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2010 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.539 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.554 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx204 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.563 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.575 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx10003 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.584 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.596 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.606 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.617 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vmx controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.628 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.639 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx480 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.648 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.673 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.683 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.694 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx240 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.704 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.716 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.967 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:339.986 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2008 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:339.995 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.032 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.046 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.063 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.079 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.094 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.105 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.120 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:infra-bms-access controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.130 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.143 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:overlay-bgp controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.154 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.168 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l2-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.178 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.191 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:underlay-ip-clos controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.201 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.214 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.224 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.239 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:vn-interconnect controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.249 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.261 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:telemetry controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.273 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.285 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.296 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.315 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.331 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.351 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5800 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.384 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.403 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.420 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:firewall controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.435 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.454 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.469 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.611 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.686 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.727 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.742 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.762 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.776 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48y-8c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.790 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-ebgp-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.806 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.818 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.830 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_deactivate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.855 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.867 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.899 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.915 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:340.938 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.957 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:340.979 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.007 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.023 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.042 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:route-reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.053 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.074 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.085 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.098 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-5 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.114 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.130 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating snmp-profile:default-domain:default-project:snmp-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.140 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.158 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.172 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:image_upgrade_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.200 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.212 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.229 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.243 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5400 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.274 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.300 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.320 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_server_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.348 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.366 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.418 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.439 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.460 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.477 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.489 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.505 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:341.518 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.530 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating netconf-profile:default-domain:default-project:netconf-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:341.548 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:342.550 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:342.891 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:344.900 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 4c62553e-1929-40a8-9a83-65a3f68538fd controller/src/ifmap/client/config_json_parser.cc 217 2025-03-24 Mon 00:49:27:344.930 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 4c62553e-1929-40a8-9a83-65a3f68538fd controller/src/ifmap/client/config_json_parser.cc 217 2025-03-24 Mon 00:49:27:345.306 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:345.502 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:345.547 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:345.564 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:345.583 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:345.597 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hardware_inventory_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:345.621 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:342.946 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:345.636 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-32c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:345.785 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:345.804 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_interface_details_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:347.357 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:347.408 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:347.458 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:347.479 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:erb-ucast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:349.311 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.368 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.384 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:349.406 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.424 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:349.455 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.471 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:349.482 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.502 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.518 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.532 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-client controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:349.546 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.562 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.573 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:349.598 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.616 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-4 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:349.633 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:349.649 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating grpc-profile:default-domain:default-project:grpc-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:349.668 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 78563a6c-d39d-4530-b75e-15f605814e25 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:27:349.788 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 7a5c261e-4634-4a66-913c-e9da7e6f3631 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:27:349.671 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.018 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:350.033 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.057 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.075 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.090 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.105 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.127 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.147 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.162 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.179 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.192 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dci-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:350.205 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.220 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.233 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:350.257 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.275 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:350.439 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4200 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:350.451 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-36q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:350.466 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:350.482 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.498 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.513 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.530 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.544 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.558 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.571 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.887 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.913 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:350.937 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.087 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.113 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:351.131 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.149 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.163 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.181 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.198 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.215 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.236 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-fabric-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:351.495 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.534 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5120 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:351.560 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.587 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.612 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.627 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48t-6c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:351.637 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.668 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.683 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:351.700 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.718 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.748 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.765 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.781 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.798 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.814 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.830 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.844 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.858 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-mcast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:351.869 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.884 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.900 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:351.921 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:351.940 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.958 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.975 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:351.987 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.004 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.018 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.028 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.041 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-48s-4c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.051 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.065 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.076 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.087 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-6 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.104 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.123 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.140 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-72q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.151 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:lean controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.166 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.180 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.191 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.207 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.220 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:server_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.240 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.254 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:device-functional-group controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.269 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.280 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-overlay-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.298 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.477 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.494 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5220 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.515 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.530 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-128c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.544 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.569 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-32cd controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.579 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.595 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.607 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-access-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.624 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.636 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.660 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.677 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.692 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.706 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.716 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.728 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:container_cleanup_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.760 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.774 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-management-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.793 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.805 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-pnf-servicechain-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.824 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:352.967 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:352.983 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.000 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.016 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.031 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.045 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.059 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.074 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.088 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.102 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.116 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:port-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.126 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.139 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.149 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.164 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.195 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.212 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.232 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.245 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.257 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.274 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.288 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_ops_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.309 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.323 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.339 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.353 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-3 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.368 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.386 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.404 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-aa controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.421 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.447 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.468 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_role_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.490 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.502 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.516 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.532 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.548 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.563 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.578 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.593 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.609 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.632 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.648 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.669 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.681 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.699 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.712 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.733 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.749 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.768 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.784 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.795 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:vcenter_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.816 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.829 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4600 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.840 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5120:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.866 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.882 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.900 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.910 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.926 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.942 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:353.955 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5600 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.966 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_chassis_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:353.993 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.005 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.018 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.031 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.047 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.063 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.079 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.093 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.108 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.125 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.139 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.153 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.169 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-access controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.179 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.195 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.208 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.227 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.246 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-mx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.261 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.274 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.302 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.323 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.335 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:erb-leaf:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.349 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:erb-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.360 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.374 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.390 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.402 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.415 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.442 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.470 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.488 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.501 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.522 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.538 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.553 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.569 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.584 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.599 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.614 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.631 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.645 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.670 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.685 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.706 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.721 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L2-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.738 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.756 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.768 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:check_multicast_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.797 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.810 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.840 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.858 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.874 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.889 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.905 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.921 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.934 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.951 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.964 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:354.979 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:354.994 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.010 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.025 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.037 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.109 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.124 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.136 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4100 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.147 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.164 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.175 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:355.178 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_device_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.222 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.235 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.256 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.269 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hitless_upgrade_strategy_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.291 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.308 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.320 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.334 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.344 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.368 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.379 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.391 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.409 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.425 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.444 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.464 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-48y controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.484 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.516 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.529 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.545 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.564 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.581 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.597 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.615 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.631 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.662 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.676 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vqfx-10000 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.690 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.710 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.738 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Leaf-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.757 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.776 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.788 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx1500 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.800 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:search_ip_mac_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.825 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.839 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:node_profile_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.856 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.871 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Gateway-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.895 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.918 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.940 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5220:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:355.975 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:355.994 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Spine-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.012 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.031 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.044 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:_internal_vn_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.065 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.083 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:_internal_ipam_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.095 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:default-project:_internal_ipam_ipv6_link_local,default-domain:default-project:_internal_vn_ipv6_link_local) controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.106 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.119 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.144 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.164 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.178 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.187 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:356.202 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.231 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.245 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.260 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.274 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.291 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.306 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.324 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.340 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.355 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.370 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.385 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.400 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.413 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.416 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262295508736, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:27:356.433 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.448 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.463 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.483 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.511 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.534 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.556 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.571 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.588 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.603 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.617 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.633 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.648 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.675 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.694 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.717 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.741 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.761 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-all-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.776 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.818 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.833 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.864 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.881 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.899 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.912 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-leaf:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.931 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.944 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.961 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:356.974 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:356.995 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.011 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.027 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.045 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.061 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.078 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.094 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.114 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.137 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.156 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.176 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.192 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.207 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.358 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262295508736, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 9b788b7f-0917-4dfc-8bf1-587cd847a234 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:27:357.375 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.398 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.413 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.427 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.441 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.459 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.476 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.491 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.514 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-spine:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.543 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.563 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.577 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.623 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.640 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.661 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.680 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.698 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.708 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:ztp_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.732 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.755 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.780 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.803 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.820 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-srx controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.838 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.859 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.874 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.892 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.907 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.919 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.937 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.953 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.967 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:357.979 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx240h-poe controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:357.989 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.004 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vsrx controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:358.014 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.029 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.041 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:358.054 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Lean-Spine-with-Route-Reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:358.299 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.323 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.350 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.369 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:358.387 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.404 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:358.419 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.435 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.452 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.470 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.485 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.500 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.515 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.535 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.557 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.579 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.600 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.628 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.662 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-peer-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:358.717 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.756 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.776 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:358.800 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:358.824 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:358.844 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.018 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.047 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.084 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.105 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:topology_discovery_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.138 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.163 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.194 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.223 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.240 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.262 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.282 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.297 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.315 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.331 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.350 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.385 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.399 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.415 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.432 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.448 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.464 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.481 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.496 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.514 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.530 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.545 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.567 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.589 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:359.612 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.632 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.651 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.676 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.691 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:359.705 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.006 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.073 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.102 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.130 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.162 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.186 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_os_computes_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.246 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.263 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:role_assignment_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.285 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.307 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-srx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.326 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.350 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.365 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.382 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.398 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-properties:default-global-system-config:config_property controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.430 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-properties controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.448 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.467 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.482 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:test_overlay_connectivity_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.504 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.519 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-60c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.542 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.557 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.570 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.592 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.606 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.628 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.646 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.677 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.698 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.716 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.731 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.746 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.763 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.779 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.793 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.808 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.824 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.839 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.852 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-32c-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.862 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.880 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.890 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.904 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.918 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.934 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.947 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5210-64c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:364.959 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.979 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:364.999 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.016 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:existing_fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.038 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.066 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.089 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.120 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.145 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.169 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.187 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:cli_sync_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.214 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.236 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.253 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.391 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.409 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.423 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.437 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.452 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.467 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.482 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.512 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.533 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.548 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.564 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.582 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.599 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.619 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.638 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.667 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.684 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Storage-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.706 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.723 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.746 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.761 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:rma_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.786 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.807 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.828 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.842 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_mac_mob_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.863 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.877 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.893 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.906 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.930 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.945 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:365.960 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.975 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:365.990 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.007 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.023 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.038 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.052 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.069 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.083 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.099 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.113 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:49:27:366.129 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.145 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:366.165 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:49:27:367.532 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 86 2025-03-24 Mon 00:49:27:367.578 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 98 2025-03-24 Mon 00:49:27:367.588 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 98 2025-03-24 Mon 00:49:27:367.597 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 3 elements controller/src/dns/main.cc 98 2025-03-24 Mon 00:49:27:367.606 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 1 elements controller/src/dns/main.cc 98 2025-03-24 Mon 00:49:27:367.615 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 98 2025-03-24 Mon 00:49:27:367.622 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 1 controller/src/dns/main.cc 109 2025-03-24 Mon 00:49:27:367.630 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 3 controller/src/dns/main.cc 120 2025-03-24 Mon 00:49:27:367.637 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 131 2025-03-24 Mon 00:49:27:367.644 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 142 2025-03-24 Mon 00:49:27:367.651 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 152 2025-03-24 Mon 00:49:27:368.277 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 159 2025-03-24 Mon 00:49:27:368.302 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 168 2025-03-24 Mon 00:49:27:370.778 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:27:370.946 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: SANDESH: Send FAILED: 1742777367367708 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.23:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-03-24 Mon 00:49:27:370.966 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:27:478.217 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 152 2025-03-24 Mon 00:49:27:478.293 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261942347520, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 219 2025-03-24 Mon 00:49:27:478.339 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-24 Mon 00:49:27:478.356 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1):EvTcpConnectFail 2025-03-24 Mon 00:49:27:478.563 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 737 2025-03-24 Mon 00:49:27:478.236 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:27:479.136 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777367478145 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.23:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:27:479.148 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:27:479.159 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvTcpConnectFail in state Connect 2025-03-24 Mon 00:49:27:479.167 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Connect : EvTcpConnectFail 2025-03-24 Mon 00:49:27:479.302 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-24 Mon 00:49:27:479.348 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Idle 2025-03-24 Mon 00:49:27:479.450 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:27:479.629 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777367479244 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 881, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:27:479.647 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:27:479.692 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:27:479.715 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777367479269 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:27:479.755 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:27:479.764 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-24 Mon 00:49:27:479.830 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:27:479.993 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777367479437 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:27:480.008 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:28:301.192 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:28:334.877 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:28:361.321 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:28:479.475 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-24 Mon 00:49:28:479.805 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Connect : Start Connect timer 10.0.0.57:8086 2025-03-24 Mon 00:49:28:479.826 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-24 Mon 00:49:28:479.852 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1):EvTcpConnectFail 2025-03-24 Mon 00:49:28:479.952 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:28:480.002 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: SANDESH: Send FAILED: 1742777368479533 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:28:480.012 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:28:480.021 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvTcpConnectFail in state Connect 2025-03-24 Mon 00:49:28:480.028 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Connect : EvTcpConnectFail 2025-03-24 Mon 00:49:28:480.191 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-24 Mon 00:49:28:480.239 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Idle 2025-03-24 Mon 00:49:28:480.310 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:28:480.956 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: SANDESH: Send FAILED: 1742777368479909 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 155 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 885, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 13, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:28:480.992 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:28:481.005 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:28:481.145 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: SANDESH: Send FAILED: 1742777368480079 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 155 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 885, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:28:481.162 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:28:481.174 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:28:481.204 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: SANDESH: Send FAILED: 1742777368480104 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:28:481.212 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:28:481.220 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-24 Mon 00:49:28:481.244 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:28:481.408 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: SANDESH: Send FAILED: 1742777368480301 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 155 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 886, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:28:481.423 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:28:556.538 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:28:588.413 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 455 2025-03-24 Mon 00:49:28:596.976 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:28:617.299 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:28:910.149 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:28:910.462 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 7a5a7a23-71d5-4f3a-9da7-386274f73306 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:28:924.242 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:28:924.372 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router b5537d42-cafe-4051-8bcb-2926ae6ff6c4 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:29:013.029 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:29:013.172 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 5b171f85-0f44-43f7-8d41-7b294064ba2f controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:29:022.603 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:29:022.743 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router b5537d42-cafe-4051-8bcb-2926ae6ff6c4 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:29:093.377 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:29:093.514 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 7a5a7a23-71d5-4f3a-9da7-386274f73306 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:29:094.316 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:49:29:094.424 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 5b171f85-0f44-43f7-8d41-7b294064ba2f controller/src/ifmap/client/config_json_parser.cc 223 2025-03-24 Mon 00:49:30:480.415 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-24 Mon 00:49:30:480.776 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Connect : Start Connect timer 10.0.0.50:8086 2025-03-24 Mon 00:49:30:481.015 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:30:481.057 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777370480584 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:30:481.078 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:30:481.087 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:30:481.242 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777370480997 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 902, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:30:481.258 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:30:481.326 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-24 Mon 00:49:30:481.356 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1):EvTcpConnectFail 2025-03-24 Mon 00:49:30:481.410 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvTcpConnectFail in state Connect 2025-03-24 Mon 00:49:30:481.426 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Connect : EvTcpConnectFail 2025-03-24 Mon 00:49:30:481.573 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-24 Mon 00:49:30:481.609 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Idle 2025-03-24 Mon 00:49:30:481.689 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:30:481.952 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777370481514 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.23:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 902, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:30:481.978 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:30:481.990 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:30:482.012 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777370481548 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:30:482.019 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:30:482.027 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-24 Mon 00:49:30:482.048 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:30:482.189 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777370481675 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.23:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 903, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:30:482.204 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:34:481.718 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-24 Mon 00:49:34:481.938 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Connect : Start Connect timer 10.0.0.23:8086 2025-03-24 Mon 00:49:34:482.075 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:34:482.116 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777374481796 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.23:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:34:482.128 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:34:482.138 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:34:482.355 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777374482057 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.23:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 903, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:34:482.386 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:34:482.433 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-24 Mon 00:49:34:482.445 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1):EvTcpConnectFail 2025-03-24 Mon 00:49:34:482.490 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvTcpConnectFail in state Connect 2025-03-24 Mon 00:49:34:482.503 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Connect : EvTcpConnectFail 2025-03-24 Mon 00:49:34:482.674 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-24 Mon 00:49:34:482.706 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Idle 2025-03-24 Mon 00:49:34:482.767 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:34:482.937 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: SANDESH: Send FAILED: 1742777374482616 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 903, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:34:482.957 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:34:482.967 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:34:482.989 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: SANDESH: Send FAILED: 1742777374482642 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:34:482.998 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:34:483.006 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-24 Mon 00:49:34:483.040 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:34:483.180 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: SANDESH: Send FAILED: 1742777374482756 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 904, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:34:483.192 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:42:482.879 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-24 Mon 00:49:42:483.117 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Connect : Start Connect timer 10.0.0.57:8086 2025-03-24 Mon 00:49:42:483.205 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-24 Mon 00:49:42:483.260 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1):EvTcpConnectFail 2025-03-24 Mon 00:49:42:483.218 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:42:483.309 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777382482968 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:42:483.318 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:42:483.328 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:42:483.473 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777382483204 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 904, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:42:483.497 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:42:483.507 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvTcpConnectFail in state Connect 2025-03-24 Mon 00:49:42:483.514 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Connect : EvTcpConnectFail 2025-03-24 Mon 00:49:42:483.620 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-24 Mon 00:49:42:483.688 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Idle 2025-03-24 Mon 00:49:42:483.802 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:42:483.951 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777382483567 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 904, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:42:483.972 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:42:483.982 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:42:484.003 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777382483593 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:42:484.009 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:42:484.017 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-24 Mon 00:49:42:484.047 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:42:484.209 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: SANDESH: Send FAILED: 1742777382483789 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 905, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:42:484.284 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:56:308.117 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:56:308.213 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: SANDESH: Send FAILED: 1742777396307968 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 33 dequeues = 33 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 49 dequeues = 49 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742777382483686 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742777382484046 ] max_sm_queue_count = 5 ] 2025-03-24 Mon 00:49:56:308.227 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:56:308.235 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:56:308.390 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: SANDESH: Send FAILED: 1742777396308090 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 905, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:56:308.403 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:58:483.780 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-24 Mon 00:49:58:484.015 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Connect : Start Connect timer 10.0.0.50:8086 2025-03-24 Mon 00:49:58:484.146 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:58:484.183 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: SANDESH: Send FAILED: 1742777398483861 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:58:484.202 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:58:484.211 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:49:58:484.357 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: SANDESH: Send FAILED: 1742777398484131 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 905, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:58:484.373 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:58:484.686 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-24 Mon 00:49:58:484.728 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1):EvTcpConnectFail 2025-03-24 Mon 00:49:58:484.756 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvTcpConnectFail in state Connect 2025-03-24 Mon 00:49:58:484.782 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Connect : EvTcpConnectFail 2025-03-24 Mon 00:49:58:484.926 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-24 Mon 00:49:58:484.964 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Idle 2025-03-24 Mon 00:49:58:485.041 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:58:485.195 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: SANDESH: Send FAILED: 1742777398484864 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.23:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 905, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:58:485.217 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:49:58:485.228 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:58:485.250 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: SANDESH: Send FAILED: 1742777398484900 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:49:58:485.256 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:49:58:485.264 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-24 Mon 00:49:58:485.292 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:49:58:485.476 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: SANDESH: Send FAILED: 1742777398485029 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.23:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 906, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:49:58:485.501 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262308103936, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:26:028.546 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:50:26:028.751 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:50:26:028.810 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:50:26:072.866 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:50:26:073.006 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:50:26:073.041 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:50:26:087.216 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:50:26:087.353 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:50:26:087.388 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:50:26:308.698 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:26:308.790 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: SANDESH: Send FAILED: 1742777426308538 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 40 dequeues = 40 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 59 dequeues = 59 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742777398484962 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742777398485290 ] max_sm_queue_count = 5 ] 2025-03-24 Mon 00:50:26:308.804 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:26:308.813 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:26:308.995 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: SANDESH: Send FAILED: 1742777426308666 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.23:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 915, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:50:26:309.019 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:26:730.998 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:26:731.050 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: SANDESH: Send FAILED: 1742777426730932 [SYS_NOTICE]: UveDnsInfo: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 start_time = 1742777366490707 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-03-20 00:12:26.938346","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-8222-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.23:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.21, ] ] ] 2025-03-24 Mon 00:50:26:731.064 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: UveDnsInfo 2025-03-24 Mon 00:50:28:485.068 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-24 Mon 00:50:28:485.288 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Connect : Start Connect timer 10.0.0.23:8086 2025-03-24 Mon 00:50:28:485.410 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:50:28:485.439 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: SANDESH: Send FAILED: 1742777428485154 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.23:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:50:28:485.449 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:50:28:485.457 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:50:28:485.732 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: SANDESH: Send FAILED: 1742777428485395 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.23:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 915, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 43, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:50:28:485.757 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:28:485.810 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-24 Mon 00:50:28:485.819 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1):EvTcpConnectFail 2025-03-24 Mon 00:50:28:485.860 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Processing scm::EvTcpConnectFail in state Connect 2025-03-24 Mon 00:50:28:485.904 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Connect : EvTcpConnectFail 2025-03-24 Mon 00:50:28:486.061 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-24 Mon 00:50:28:486.101 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Idle 2025-03-24 Mon 00:50:28:486.175 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:28:486.341 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: SANDESH: Send FAILED: 1742777428486000 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 915, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:50:28:486.361 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:28:486.371 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:28:486.392 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: SANDESH: Send FAILED: 1742777428486034 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:50:28:486.399 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:50:28:486.406 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-24 Mon 00:50:28:486.429 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:28:486.580 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: SANDESH: Send FAILED: 1742777428486162 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 916, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:50:28:486.595 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:56:308.991 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:56:309.079 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: SANDESH: Send FAILED: 1742777456308828 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 48 dequeues = 48 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 70 dequeues = 70 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742777428486099 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742777428486427 ] max_sm_queue_count = 5 ] 2025-03-24 Mon 00:50:56:309.092 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:56:309.100 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:56:309.297 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: SANDESH: Send FAILED: 1742777456308953 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 916, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 48, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:50:56:309.328 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:58:486.246 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-24 Mon 00:50:58:486.574 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: Connect : Start Connect timer 10.0.0.57:8086 2025-03-24 Mon 00:50:58:486.756 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:50:58:486.799 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: SANDESH: Send FAILED: 1742777458486354 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.57:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:50:58:486.808 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:50:58:486.816 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:50:58:487.008 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: SANDESH: Send FAILED: 1742777458486737 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.57:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 916, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 50, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:50:58:487.027 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:58:487.063 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-24 Mon 00:50:58:487.071 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: -(-1):EvTcpConnectFail 2025-03-24 Mon 00:50:58:487.133 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Processing scm::EvTcpConnectFail in state Connect 2025-03-24 Mon 00:50:58:487.172 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Connect : EvTcpConnectFail 2025-03-24 Mon 00:50:58:487.369 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-24 Mon 00:50:58:487.417 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Idle 2025-03-24 Mon 00:50:58:487.496 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:58:487.770 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SANDESH: Send FAILED: 1742777458487301 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 916, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:50:58:487.804 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:50:58:487.822 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:58:487.856 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SANDESH: Send FAILED: 1742777458487340 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:50:58:487.866 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:50:58:487.878 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-24 Mon 00:50:58:487.907 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:50:58:488.138 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SANDESH: Send FAILED: 1742777458487477 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 917, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:50:58:488.156 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:51:16:022.633 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:51:16:022.863 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:51:16:022.926 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:51:16:112.138 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:51:16:112.346 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:51:16:112.418 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:51:16:550.449 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:51:16:550.601 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:51:16:550.638 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:51:26:309.262 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:51:26:309.357 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: SANDESH: Send FAILED: 1742777486309065 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 55 dequeues = 55 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 80 dequeues = 80 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742777458487414 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742777458487906 ] max_sm_queue_count = 5 ] 2025-03-24 Mon 00:51:26:309.382 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:51:26:309.395 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: Processing scm::EvSandeshSend in state Idle 2025-03-24 Mon 00:51:26:309.651 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: SANDESH: Send FAILED: 1742777486309219 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 170 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 926, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 55, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:51:26:309.703 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261946545920, Pid 27362]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:51:28:487.518 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-24 Mon 00:51:28:487.825 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Connect : Start Connect timer 10.0.0.50:8086 2025-03-24 Mon 00:51:28:487.988 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:51:28:488.034 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: SANDESH: Send FAILED: 1742777488487607 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:51:28:488.044 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-24 Mon 00:51:28:488.053 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Processing scm::EvSandeshSend in state Connect 2025-03-24 Mon 00:51:28:488.222 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: SANDESH: Send FAILED: 1742777488487966 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 170 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 926, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:51:28:488.240 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-24 Mon 00:51:28:491.002 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.57:38258::10.0.0.50:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-03-24 Mon 00:51:28:491.032 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: 10.0.0.57:38258::10.0.0.50:8086(-1) OnSessionEvent TCP Connected 2025-03-24 Mon 00:51:28:491.040 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: 10.0.0.57:38258::10.0.0.50:8086(-1):EvTcpConnected 2025-03-24 Mon 00:51:28:494.898 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: Processing scm::EvTcpConnected in state Connect 2025-03-24 Mon 00:51:28:494.946 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: Connect : EvTcpConnected : Cancelling Connect timer 2025-03-24 Mon 00:51:28:494.998 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: ClientInit 2025-03-24 Mon 00:51:28:495.027 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2938-3:contrail-dns:0:Control count 1 2025-03-24 Mon 00:51:28:495.149 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: Processing scm::EvSandeshSend in state ClientInit 2025-03-24 Mon 00:51:28:495.162 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-03-24 Mon 00:51:28:495.186 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: SANDESH: Send FAILED: 1742777488494988 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-24 Mon 00:51:28:495.194 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: Received UVE message in wrong state : NodeStatusUVE 2025-03-24 Mon 00:51:28:495.202 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: Processing scm::EvSandeshSend in state ClientInit 2025-03-24 Mon 00:51:28:495.216 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-03-24 Mon 00:51:28:495.229 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: Processing scm::EvSandeshSend in state ClientInit 2025-03-24 Mon 00:51:28:495.235 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-03-24 Mon 00:51:28:495.393 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: SANDESH: Send FAILED: 1742777488495130 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 170 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 927, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-24 Mon 00:51:28:495.409 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-03-24 Mon 00:51:28:499.430 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: OnMessage control in state: ClientInit 2025-03-24 Mon 00:51:28:499.490 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-03-24 Mon 00:51:28:499.500 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: ClientInit : EvSandeshMessageRecv 2025-03-24 Mon 00:51:28:499.524 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Received Ctrl Message with size 0 2025-03-24 Mon 00:51:28:499.541 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2938-3 start_time = 1742777366490707 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-03-20 00:12:26.938346","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-8222-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.23:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.21, ] ] proxy seq 1 2025-03-24 Mon 00:51:28:499.554 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-03-24 Mon 00:51:28:499.863 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2938-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 27362 http_port = 8092 start_time = 1742777366307534 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.23:8086, (*_iter40) = 10.0.0.57:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 55 dequeues = 55 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 80 dequeues = 80 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742777458487414 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742777458487906 ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 170 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 927, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 5 proxy seq 37 2025-03-24 Mon 00:51:28:499.899 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-03-24 Mon 00:51:28:499.957 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2938-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.23:9041, (*_iter6) = 10.0.0.50:9041, (*_iter6) = 10.0.0.57:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.23:5673, (*_iter6) = 10.0.0.50:5673, (*_iter6) = 10.0.0.57:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 24 2025-03-24 Mon 00:51:28:499.970 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-03-24 Mon 00:51:28:499.979 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-03-24 Mon 00:51:28:499.986 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-03-24 Mon 00:51:28:499.998 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-03-24 Mon 00:51:28:500.042 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: Established 2025-03-24 Mon 00:51:39:314.190 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262316500736, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:51:39:314.500 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:51:39:314.557 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:51:39:428.449 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:51:39:428.600 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:51:39:428.633 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:51:39:461.826 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:51:39:461.988 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:51:39:462.026 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261938149120, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:51:41:068.364 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: OnMessage control in state: Established 2025-03-24 Mon 00:51:41:068.430 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: Processing scm::EvSandeshMessageRecv in state Established 2025-03-24 Mon 00:51:41:068.440 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: Established : EvSandeshMessageRecv 2025-03-24 Mon 00:51:41:068.482 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: Received Ctrl Message with size 3 2025-03-24 Mon 00:51:41:068.495 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: SyncAllMaps for DnsState:0 period 0 cycle 0 with seqno 1, total = 0 2025-03-24 Mon 00:51:41:068.505 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 38, total = 0 2025-03-24 Mon 00:51:41:068.515 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 26, total = 0 2025-03-24 Mon 00:51:41:068.531 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-03-24 Mon 00:51:41:068.538 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-03-24 Mon 00:51:41:068.545 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262320699136, Pid 27362]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-03-24 Mon 00:51:53:238.689 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:51:53:238.832 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:51:53:238.869 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261933950720, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:51:53:323.061 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:51:53:323.208 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:51:53:323.245 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:51:53:348.462 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:51:53:348.700 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2938-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:51:53:348.746 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:53:29:957.735 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.21:43530 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:53:30:185.750 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.6:60240 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:53:30:746.738 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.6:60246 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:53:30:899.818 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.5:51768 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:53:30:993.560 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.21:43544 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:53:31:219.352 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.5:51772 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:53:46:796.536 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:53:46:948.009 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:53:46:948.192 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2938-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:53:46:948.229 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261950744320, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:53:47:319.448 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:53:47:319.605 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2938-2:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:53:47:319.642 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:53:47:319.683 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262303905536, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:53:47:373.372 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:53:47:757.886 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262295508736, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:53:47:758.030 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262295508736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2938-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:53:47:758.067 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262295508736, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:53:47:911.069 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262299707136, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:53:48:146.461 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:53:48:146.643 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2938-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-24 Mon 00:53:48:146.697 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:53:48:146.727 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140261954942720, Pid 27362]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-24 Mon 00:53:48:238.904 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262312302336, Pid 27362]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-24 Mon 00:58:29:966.235 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.21:45604 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:58:30:189.200 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.6:51178 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:58:30:749.763 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.6:51192 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:58:30:902.790 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.5:47550 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:58:30:994.963 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.21:45616 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 00:58:31:221.914 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.5:47552 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:03:29:970.292 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.21:33098 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:03:30:193.208 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.6:53532 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:03:30:751.067 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.6:53540 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:03:30:903.855 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.5:43618 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:03:30:995.984 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.21:33114 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:03:31:218.248 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.5:43634 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:08:29:971.158 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.21:60694 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:08:30:199.310 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.6:37730 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:08:30:754.615 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.6:37738 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:08:30:908.923 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.5:56306 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:08:30:999.532 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.21:60708 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-24 Mon 01:08:31:225.306 UTC cn-jenkins-deploy-platform-ansible-os-2938-3 [Thread 140262476626048, Pid 27362]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.21:8092::10.20.0.5:56318 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254