2025-02-10 Mon 02:03:32:486.554 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2025-02-10 Mon 02:03:32:486.709 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-02-10 Mon 02:03:32:505.475 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ ] ] Export Targets export_rt= [ [ ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:03:32:510.148 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:03:32:510.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.l3vpn.0 Family inet-vpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:03:32:511.008 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.l3vpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:03:32:511.048 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet6-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:03:32:511.059 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.l3vpn-inet6.0 Family inet6-vpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:03:32:511.069 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.l3vpn-inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:03:32:511.084 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:03:32:511.092 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:03:32:511.101 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:03:32:511.115 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:03:32:511.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:03:32:511.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:03:32:511.213 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:03:32:511.223 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:03:32:511.236 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:03:32:511.248 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.rtarget.0 Family route-target controller/src/bgp/routing-instance/routing_instance.cc 1672 2025-02-10 Mon 02:03:32:511.260 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = route-target hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:03:32:511.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:03:32:511.289 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet-labeled hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:03:32:511.303 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:03:32:511.323 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ ] ] Export Targets export_rt= [ [ ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:03:32:511.413 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ ] ] Export Targets export_rt= [ [ ] ] Virtual Network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2016 2025-02-10 Mon 02:03:32:513.101 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigProtocolCreateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ AdminDown 0 Local AS 64512 Router ID Address Hold Time 0 Address Families families= [ [ ] ] controller/src/bgp/bgp_config_ifmap.cc 2026 2025-02-10 Mon 02:03:32:520.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.0.0.38:5269 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:03:32:521.182 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: ROLE : Generator 2025-02-10 Mon 02:03:32:521.198 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: MODULE : contrail-control 2025-02-10 Mon 02:03:32:521.203 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-juju-os-472-1 2025-02-10 Mon 02:03:32:521.209 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: NODE TYPE : Control 2025-02-10 Mon 02:03:32:521.214 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: INSTANCE ID : 0 2025-02-10 Mon 02:03:32:521.219 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: HTTP SERVER PORT : 8083 2025-02-10 Mon 02:03:32:521.226 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-02-10 Mon 02:03:32:521.814 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: HTTP Introspect Init 2025-02-10 Mon 02:03:32:521.974 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8083 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:03:32:522.026 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: Sandesh Http Server Port: 8083 2025-02-10 Mon 02:03:32:522.128 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: NOT Writing http_port 8083TO : /tmp/contrail-control.0.http_port 2025-02-10 Mon 02:03:32:522.140 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2025-02-10 Mon 02:03:32:523.474 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: Idle 2025-02-10 Mon 02:03:32:524.465 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: SANDESH: No Client: 1739153012523621 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:03:32:528.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvStart in state Idle 2025-02-10 Mon 02:03:32:528.493 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 303 2025-02-10 Mon 02:03:32:528.596 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Disconnect 2025-02-10 Mon 02:03:32:537.500 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2025-02-10 Mon 02:03:32:537.865 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:03:32:537.941 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:32:537.967 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153012528576 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database:Cassandra,Database:RabbitMQ, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:32:537.976 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:32:537.985 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:32:538.084 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153012537461 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 2, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:03:32:538.101 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:32:538.111 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:32:538.191 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153012537594 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 2, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:03:32:538.203 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:32:538.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:32:538.229 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153012537629 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database:Cassandra,Database:RabbitMQ, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:32:538.235 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:32:538.246 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:32:538.319 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153012537928 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 2, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:03:32:538.328 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:32:538.449 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-02-10 Mon 02:03:32:538.489 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-02-10 Mon 02:03:32:538.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:32:538.526 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153012538419 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:32:538.534 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:32:553.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:36388::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:03:32:553.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:36388::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:03:32:553.134 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:36388::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:03:32:553.204 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:03:32:553.220 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:03:32:553.263 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit 2025-02-10 Mon 02:03:32:553.293 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 1 2025-02-10 Mon 02:03:32:553.379 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:32:553.389 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:03:32:553.412 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153012553255 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:32:553.420 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:03:32:553.434 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:32:553.441 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:03:32:553.465 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:32:553.472 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:03:32:553.589 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153012553368 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 5, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 6, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:03:32:553.603 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:03:32:557.802 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.38:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-02-10 Mon 02:03:33:553.411 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: 10.0.0.38:8086 EvConnectTimerExpired in state ClientInit 2025-02-10 Mon 02:03:33:553.473 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvConnectTimerExpired in state ClientInit 2025-02-10 Mon 02:03:33:553.484 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ClientInit : EvConnectTimerExpired 2025-02-10 Mon 02:03:33:553.611 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:03:33:553.622 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Idle 2025-02-10 Mon 02:03:33:553.724 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:33:553.751 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153013553523 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvConnectTimerExpired ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:33:553.760 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:33:553.769 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:03:33:553.818 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:33:553.958 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153013553712 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 1 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1689 calls = 1 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 6, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 8, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:03:33:553.979 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:37:558.106 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.38:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-02-10 Mon 02:03:38:553.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:03:38:554.716 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:03:38:554.866 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:38:554.896 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: SANDESH: Send FAILED: 1739153018554287 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:38:554.906 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:38:554.916 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:38:555.051 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: SANDESH: Send FAILED: 1739153018554846 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 1 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1689 calls = 1 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 7, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:03:38:555.110 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:38:572.402 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:39694::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:03:38:572.448 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:39694::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:03:38:572.457 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:39694::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:03:38:572.553 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:03:38:572.592 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:03:38:572.645 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit 2025-02-10 Mon 02:03:38:572.712 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 2 2025-02-10 Mon 02:03:38:572.816 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:38:572.827 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:03:38:572.850 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153018572636 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:38:572.866 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:03:38:572.875 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:38:572.882 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:03:38:572.908 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:38:572.915 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:03:38:573.050 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153018572800 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 2 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1689 calls = 1 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 8, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 12, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:03:38:573.068 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:03:39:177.264 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:43856 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:03:40:573.753 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: 10.0.0.38:8086 EvConnectTimerExpired in state ClientInit 2025-02-10 Mon 02:03:40:573.835 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvConnectTimerExpired in state ClientInit 2025-02-10 Mon 02:03:40:573.846 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvConnectTimerExpired 2025-02-10 Mon 02:03:40:574.904 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:03:40:574.923 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Idle 2025-02-10 Mon 02:03:40:575.025 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:40:575.068 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153020573892 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvConnectTimerExpired ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:40:575.078 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:40:575.088 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:03:40:575.129 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:40:575.325 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153020575010 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 2 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 3378 calls = 2 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 9, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:03:40:575.348 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:42:558.587 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.38:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-02-10 Mon 02:03:45:575.011 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:03:45:578.703 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:39748::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:03:45:578.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:39748::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:03:45:578.755 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:39748::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:03:45:578.791 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:03:45:578.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:45:578.926 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153025575092 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:45:578.935 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:45:578.946 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:03:45:578.953 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:03:45:578.984 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit 2025-02-10 Mon 02:03:45:578.998 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 3 2025-02-10 Mon 02:03:45:579.059 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:45:579.068 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:03:45:579.221 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153025578881 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 2 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 3378 calls = 2 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 11, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:03:45:579.241 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:03:45:579.251 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:45:579.258 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:03:45:579.277 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153025578978 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:45:579.284 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:03:45:579.292 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:45:579.298 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:03:45:579.309 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:45:579.316 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:03:45:579.433 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153025579050 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 3 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 3378 calls = 2 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 11, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:03:45:579.448 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:03:47:581.954 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-02-10 Mon 02:03:47:582.005 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 307 2025-02-10 Mon 02:03:47:582.046 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 580 2025-02-10 Mon 02:03:47:582.057 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:03:47:582.057 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:47:582.134 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:03:47:582.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153027581898 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:47:582.182 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:03:47:582.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:47:582.201 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:03:47:582.219 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153027582038 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:47:582.235 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:03:47:586.743 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigCassInitErrorMessage: Database initialization failed src/contrail-common/config-client-mgr/config_cassandra_client.cc 90 2025-02-10 Mon 02:03:47:586.792 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: DB uninit src/contrail-common/config-client-mgr/config_cassandra_client.cc 122 2025-02-10 Mon 02:03:49:579.091 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: 10.0.0.38:8086 EvConnectTimerExpired in state ClientInit 2025-02-10 Mon 02:03:49:581.709 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvConnectTimerExpired in state ClientInit 2025-02-10 Mon 02:03:49:581.729 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit : EvConnectTimerExpired 2025-02-10 Mon 02:03:49:581.838 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:03:49:581.848 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Idle 2025-02-10 Mon 02:03:49:581.936 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:49:581.965 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153029581763 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvConnectTimerExpired ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:49:581.974 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:49:581.982 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:03:49:581.992 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:49:582.188 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153029581925 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 3 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 5067 calls = 3 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 17, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 22, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:03:49:582.237 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:52:586.922 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:03:52:714.647 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:59788 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:03:52:727.642 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-02-10 Mon 02:03:52:731.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigCassInitErrorMessage: Setting database keyspace failed src/contrail-common/config-client-mgr/config_cassandra_client.cc 99 2025-02-10 Mon 02:03:52:731.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: DB uninit src/contrail-common/config-client-mgr/config_cassandra_client.cc 122 2025-02-10 Mon 02:03:54:582.013 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:03:54:582.347 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:03:54:582.480 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:54:582.526 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: SANDESH: Send FAILED: 1739153034582109 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:54:582.547 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:54:582.557 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:54:582.723 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: SANDESH: Send FAILED: 1739153034582466 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 3 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 5067 calls = 3 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 22, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 24, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:03:54:582.741 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:54:586.911 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:52214::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:03:54:586.941 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:52214::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:03:54:586.951 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:52214::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:03:54:587.013 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:03:54:587.052 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:03:54:587.102 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ClientInit 2025-02-10 Mon 02:03:54:587.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 4 2025-02-10 Mon 02:03:54:587.203 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:54:587.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:03:54:587.235 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: SANDESH: Send FAILED: 1739153034587095 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:54:587.242 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:03:54:587.251 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:54:587.258 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:03:54:587.275 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:54:587.282 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:03:54:587.433 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: SANDESH: Send FAILED: 1739153034587192 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 4 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 5067 calls = 3 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 23, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:03:54:587.453 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:03:54:587.891 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:52214::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:03:54:587.907 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:52214::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:03:54:587.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:03:54:588.023 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:03:54:588.077 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:03:54:588.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Idle 2025-02-10 Mon 02:03:54:588.182 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:54:588.218 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153034588061 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:54:588.229 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:54:588.241 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:03:54:588.271 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:54:588.527 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153034588169 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 4 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 6756 calls = 4 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 23, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28, _iter59->first = sent _iter59->second = 4, ] ] ] 2025-02-10 Mon 02:03:54:588.561 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:57:731.919 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:03:57:790.878 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-02-10 Mon 02:03:57:792.608 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigCassInitErrorMessage: Setting database keyspace failed src/contrail-common/config-client-mgr/config_cassandra_client.cc 99 2025-02-10 Mon 02:03:57:792.639 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: DB uninit src/contrail-common/config-client-mgr/config_cassandra_client.cc 122 2025-02-10 Mon 02:03:59:588.226 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:03:59:588.471 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:03:59:588.572 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:59:588.601 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153039588304 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:59:588.617 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:59:588.626 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:03:59:588.888 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153039588560 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 4 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 6756 calls = 4 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 27, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 4, ] ] ] 2025-02-10 Mon 02:03:59:588.915 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:03:59:591.645 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:60360::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:03:59:592.084 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:60360::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:03:59:592.112 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:60360::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:03:59:592.604 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:03:59:592.634 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:03:59:592.696 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ClientInit 2025-02-10 Mon 02:03:59:593.188 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 5 2025-02-10 Mon 02:03:59:593.288 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:59:593.298 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:03:59:593.323 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: SANDESH: Send FAILED: 1739153039592687 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:59:593.331 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:03:59:593.342 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:59:593.349 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:03:59:593.372 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:03:59:593.379 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:03:59:593.524 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: SANDESH: Send FAILED: 1739153039593276 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 5 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 6756 calls = 4 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 28, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 32, _iter59->first = sent _iter59->second = 4, ] ] ] 2025-02-10 Mon 02:03:59:593.544 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:03:59:594.257 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:60360::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:03:59:594.817 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:60360::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:03:59:594.879 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:03:59:594.906 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:03:59:594.951 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:03:59:594.961 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Idle 2025-02-10 Mon 02:03:59:595.060 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:59:595.088 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153039594936 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:03:59:595.097 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:03:59:595.106 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:03:59:595.134 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:03:59:595.274 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153039595047 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 5 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 8445 calls = 5 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 28, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 34, _iter59->first = sent _iter59->second = 5, ] ] ] 2025-02-10 Mon 02:03:59:595.294 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:00:794.784 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:43858 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:04:02:528.296 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:02:528.390 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153042528150 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 41 dequeues = 41 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 62 dequeues = 62 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739153039594960 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739153039595133 ] max_sm_queue_count = 5 ] 2025-02-10 Mon 02:04:02:528.412 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:02:528.422 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:02:528.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153042528259 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 5 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 8445 calls = 5 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 29, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 36, _iter59->first = sent _iter59->second = 5, ] ] ] 2025-02-10 Mon 02:04:02:528.580 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:02:793.018 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:04:02:828.726 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-02-10 Mon 02:04:02:832.733 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigCassInitErrorMessage: Setting database keyspace failed src/contrail-common/config-client-mgr/config_cassandra_client.cc 99 2025-02-10 Mon 02:04:02:832.774 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: DB uninit src/contrail-common/config-client-mgr/config_cassandra_client.cc 122 2025-02-10 Mon 02:04:04:595.083 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:04:595.451 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:04:595.594 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:04:595.635 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153044595202 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:04:595.646 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:04:595.659 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:04:595.934 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153044595574 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 5 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 8445 calls = 5 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 33, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 38, _iter59->first = sent _iter59->second = 5, ] ] ] 2025-02-10 Mon 02:04:04:595.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:04:601.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:60392::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:04:601.197 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:60392::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:04:601.209 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:60392::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:04:603.159 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:04:603.200 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:04:603.261 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ClientInit 2025-02-10 Mon 02:04:04:603.282 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 6 2025-02-10 Mon 02:04:04:603.477 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:04:603.498 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:04:603.534 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: SANDESH: Send FAILED: 1739153044603248 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:04:603.544 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:04:603.556 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:04:603.566 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:04:603.597 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:04:603.606 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:04:603.853 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: SANDESH: Send FAILED: 1739153044603455 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 6 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 8445 calls = 5 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 34, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 5, ] ] ] 2025-02-10 Mon 02:04:04:603.889 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:04:605.508 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:60392::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:04:605.531 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:60392::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:04:605.580 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:04:605.594 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:04:606.553 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:04:606.566 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Idle 2025-02-10 Mon 02:04:04:606.678 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:04:606.715 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153044605631 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:04:606.735 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:04:606.747 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:04:606.778 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:04:607.055 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153044606657 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 6 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 10134 calls = 6 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 34, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 42, _iter59->first = sent _iter59->second = 6, ] ] ] 2025-02-10 Mon 02:04:04:607.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:07:841.176 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:04:07:868.633 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-02-10 Mon 02:04:07:870.635 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigCassInitErrorMessage: Setting database keyspace failed src/contrail-common/config-client-mgr/config_cassandra_client.cc 99 2025-02-10 Mon 02:04:07:870.680 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: DB uninit src/contrail-common/config-client-mgr/config_cassandra_client.cc 122 2025-02-10 Mon 02:04:08:430.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36458 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:04:09:608.029 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:09:608.411 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:09:608.573 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:09:608.616 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153049608107 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:09:608.628 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:09:608.639 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:09:609.005 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153049608548 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 6 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 10134 calls = 6 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 39, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 44, _iter59->first = sent _iter59->second = 6, ] ] ] 2025-02-10 Mon 02:04:09:609.047 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:09:611.669 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:38530::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:09:611.744 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:38530::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:09:611.754 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:38530::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:09:613.140 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:09:613.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:09:613.999 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit 2025-02-10 Mon 02:04:09:614.021 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 7 2025-02-10 Mon 02:04:09:614.135 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:09:614.150 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:09:614.175 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153049613986 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:09:614.182 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:09:614.191 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:09:614.198 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:09:614.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:09:614.219 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:09:614.378 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153049614120 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 7 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 10134 calls = 6 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 40, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 46, _iter59->first = sent _iter59->second = 6, ] ] ] 2025-02-10 Mon 02:04:09:614.392 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:09:615.401 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:38530::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:09:615.420 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:38530::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:09:617.041 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:09:617.068 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:09:617.231 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:09:617.246 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Idle 2025-02-10 Mon 02:04:09:617.326 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:09:617.352 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153049617108 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:09:617.367 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:09:617.382 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:09:617.392 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:09:617.610 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153049617314 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 7 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 11823 calls = 7 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 40, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 48, _iter59->first = sent _iter59->second = 7, ] ] ] 2025-02-10 Mon 02:04:09:617.631 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:12:872.682 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:04:12:899.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-02-10 Mon 02:04:12:899.749 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 104 2025-02-10 Mon 02:04:12:899.793 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 110 2025-02-10 Mon 02:04:12:904.040 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:12:904.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153052899830 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:12:904.099 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:12:904.128 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:904.141 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 393 2025-02-10 Mon 02:04:12:918.414 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:924.192 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:936.757 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:939.036 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:941.805 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:946.903 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:948.913 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:952.078 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:954.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:956.096 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:959.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:962.149 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:962.962 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:964.534 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:966.488 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:967.835 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:970.402 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:976.755 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:977.854 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:979.190 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:983.637 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:985.034 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:985.782 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:989.455 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:991.560 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:994.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:996.417 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:997.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:12:998.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:003.162 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:004.834 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:006.264 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:007.669 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:008.443 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:009.441 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:010.262 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:011.603 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:013.067 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:017.050 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:025.020 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:026.213 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:029.532 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:030.799 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:031.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:033.302 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:034.215 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:035.732 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:038.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:049.353 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:051.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:052.306 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:055.436 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:066.282 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:083.363 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:084.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:085.696 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:086.965 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:117.460 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:123.296 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:124.774 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:125.824 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:126.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:127.536 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:131.131 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:132.628 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:135.942 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:138.547 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:141.344 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:144.802 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:147.106 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:152.319 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:154.484 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:155.861 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:160.975 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:165.106 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:166.215 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:169.952 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:180.119 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:181.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:187.976 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:189.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:193.117 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:194.218 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:195.063 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:196.235 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:197.036 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:198.433 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:199.474 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:200.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:201.325 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:202.113 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:204.183 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:205.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:206.031 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:209.648 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:210.479 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:215.159 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:216.850 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:217.620 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:218.310 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:220.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:222.273 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:224.263 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:225.152 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:226.119 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:233.878 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:236.218 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:238.372 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:242.162 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:245.254 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:252.595 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:258.418 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:260.876 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:262.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:264.251 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:267.366 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:268.867 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:270.975 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:271.048 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:04:13:271.063 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:04:13:271.074 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:04:13:271.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:04:13:271.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:04:13:271.133 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:04:13:271.142 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 554 2025-02-10 Mon 02:04:13:271.155 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 197 2025-02-10 Mon 02:04:13:271.197 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:271.265 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-02-10 Mon 02:04:13:271.083 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:04:13:275.962 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: SANDESH: Send FAILED: 1739153053271178 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:13:279.106 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:13:331.813 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:333.588 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:334.244 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:334.277 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:344.039 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:346.738 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:346.845 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:346.869 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:346.886 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:349.162 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:351.051 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:351.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:391.362 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:391.501 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:391.535 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:437.869 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:438.010 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:438.046 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:469.188 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:470.084 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:471.358 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:479.657 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:479.777 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:503.605 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:503.757 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:503.792 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:515.287 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:515.460 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:612.488 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:612.724 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:612.778 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:652.334 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:652.475 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:652.511 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:652.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:04:13:652.606 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:13:652.639 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:04:13:652.708 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:652.724 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:652.741 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:13:652.751 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:13:652.780 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:652.791 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:652.801 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:13:652.811 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:13:652.850 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:652.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:652.873 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:13:652.887 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:13:652.916 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:652.926 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:652.935 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:13:652.944 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:13:652.972 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:652.982 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:652.991 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:13:653.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:13:653.093 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:653.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153053652653 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = add_import_rt= [ [ (*_iter24) = target:64512:7999999, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:04:13:653.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:653.131 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:653.143 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153053652700 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:653.154 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:653.161 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:653.171 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153053652775 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:653.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:653.184 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:653.193 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153053652845 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:653.199 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:653.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:653.215 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153053652911 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:653.221 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:653.228 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:653.237 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153053652966 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:653.242 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:655.726 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:04:13:659.172 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36464 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:04:13:679.222 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:679.369 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:ip-fabric:__default__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:679.405 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:679.476 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:13:679.494 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:13:679.511 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:13:679.522 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:13:748.947 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:749.185 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:749.253 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:782.714 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:782.873 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:__link_local__:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:782.909 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:782.972 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:__link_local__ VN Index 3 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:04:13:782.993 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:__link_local__ VN Index 3 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:13:783.017 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 3 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:04:13:783.066 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:783.084 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:783.121 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:783.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:783.183 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:783.199 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:783.248 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:783.264 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:783.297 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:783.311 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:783.350 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 3 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:04:13:783.066 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:783.404 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053783034 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = add_import_rt= [ [ (*_iter24) = target:64512:7999999, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:04:13:783.413 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:783.423 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:783.435 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053783057 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:783.442 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:783.449 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:783.458 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053783112 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:783.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:783.475 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:783.484 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053783171 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:783.490 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:783.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:783.506 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053783240 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:783.511 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:783.518 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:783.527 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053783289 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:783.533 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:868.810 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:868.986 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:869.043 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:887.473 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:887.616 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:dci-network:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:887.653 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:887.726 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:04:13:887.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:13:887.775 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:04:13:887.828 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:887.846 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:887.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:887.891 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:887.923 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:887.934 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:887.971 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:887.981 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:888.004 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:888.018 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:888.047 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:04:13:887.822 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:888.225 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153053887792 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = add_import_rt= [ [ (*_iter24) = target:64512:7999999, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:04:13:888.237 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:888.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:888.259 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153053887821 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:888.265 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:888.273 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:888.283 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153053887875 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:888.298 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:888.305 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:888.315 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153053887918 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:888.321 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:888.328 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:888.337 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153053887964 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:888.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:888.350 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:888.359 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153053888000 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:888.365 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:905.399 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:905.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:dci-network:__default__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:905.584 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:905.650 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:04:13:905.687 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:13:905.712 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:04:13:905.760 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:905.775 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:905.821 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:905.837 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:905.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:905.893 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:905.924 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:905.934 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:905.964 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:905.974 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:906.005 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:04:13:906.020 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:906.037 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053905730 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = add_import_rt= [ [ (*_iter24) = target:64512:7999999, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:04:13:906.046 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:906.054 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:906.064 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053905753 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:906.071 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:906.078 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:906.087 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053905811 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:906.093 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:906.100 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:906.660 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053905875 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:906.685 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:906.694 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:906.705 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053905919 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:906.711 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:906.718 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:906.728 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153053905958 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:906.734 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:924.720 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:933.564 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:933.644 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:940.333 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:940.474 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:default-virtual-network:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:940.510 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:940.594 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:default-virtual-network VN Index 1 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:04:13:940.632 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:default-virtual-network VN Index 1 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:13:940.709 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 1 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:04:13:940.758 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:940.773 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:940.808 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:940.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:940.928 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153053940727 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = add_import_rt= [ [ (*_iter24) = target:64512:7999999, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:04:13:940.937 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:940.947 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:940.959 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153053940751 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:940.966 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:940.981 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:940.992 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153053940803 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:940.999 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:941.884 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:941.954 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:941.969 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:942.014 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:942.026 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:942.060 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:04:13:942.071 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:13:942.104 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 1 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:04:13:942.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:942.137 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153053941941 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:942.144 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:942.152 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:942.162 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153053942009 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:942.168 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:942.176 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:13:942.186 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153053942055 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:04:13:942.192 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:13:965.406 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:965.591 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:13:965.704 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:13:986.513 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:13:986.646 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:022.298 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:022.429 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:023.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:14:046.558 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:046.816 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:046.881 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:14:064.172 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:064.299 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:096.087 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:096.284 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:114.780 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:114.949 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:135.337 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:135.509 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:144.857 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:144.977 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:172.013 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:172.179 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:185.741 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:185.890 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:219.506 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:244.718 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:244.855 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:244.886 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:14:254.382 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:14:254.550 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:14:254.591 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:14:617.334 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:14:690.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:14:690.286 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:14:690.321 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: SANDESH: Send FAILED: 1739153054689822 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:14:690.337 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:14:690.348 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:14:690.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: SANDESH: Send FAILED: 1739153054690263 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 7 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 11823 calls = 7 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 188 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 33 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 349, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 82, _iter59->first = sent _iter59->second = 7, ] ] ] 2025-02-10 Mon 02:04:14:690.637 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:14:692.150 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:38792::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:14:692.180 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:38792::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:14:692.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:38792::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:14:692.257 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:14:692.286 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:14:692.322 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ClientInit 2025-02-10 Mon 02:04:14:692.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 8 2025-02-10 Mon 02:04:14:692.479 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:14:692.490 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:14:692.514 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153054692315 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:14:692.522 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:14:692.530 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:14:692.537 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:14:692.558 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:14:692.565 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:14:692.914 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153054692464 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 8 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 11823 calls = 7 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 188 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 33 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 350, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 84, _iter59->first = sent _iter59->second = 7, ] ] ] 2025-02-10 Mon 02:04:14:692.946 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:14:693.352 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:38792::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:14:693.376 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:38792::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:14:693.406 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:14:693.423 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:14:693.460 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:14:693.468 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Idle 2025-02-10 Mon 02:04:14:693.570 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:14:693.595 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153054693447 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:14:693.603 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:14:693.611 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:14:693.635 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:14:693.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: SANDESH: Send FAILED: 1739153054693551 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 8 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 13512 calls = 8 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 188 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 33 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 350, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 86, _iter59->first = sent _iter59->second = 8, ] ] ] 2025-02-10 Mon 02:04:14:693.903 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:14:784.705 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:16:387.431 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:16:387.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:16:387.606 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:17:301.866 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:17:304.151 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:17:304.197 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:17:534.893 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:17:535.112 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:17:535.270 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:17:790.155 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:17:790.300 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:17:790.783 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:18:078.801 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:18:078.978 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:18:079.033 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:18:110.881 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:18:111.074 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:18:111.126 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:18:192.029 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:18:193.763 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:18:193.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:18:292.245 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:18:292.443 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:18:292.509 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:18:376.649 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:18:376.829 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:18:376.865 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:19:693.574 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:19:693.824 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:19:693.971 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:19:694.002 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153059693639 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:19:694.012 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:19:694.021 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:19:694.309 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153059693950 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 8 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 13512 calls = 8 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 198 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 32 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 42 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 378, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 88, _iter59->first = sent _iter59->second = 8, ] ] ] 2025-02-10 Mon 02:04:19:694.348 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:19:696.563 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:49878::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:19:696.587 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:49878::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:19:696.595 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:49878::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:19:696.965 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:19:698.375 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:19:698.424 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ClientInit 2025-02-10 Mon 02:04:19:698.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 9 2025-02-10 Mon 02:04:19:698.568 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:19:698.579 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:19:698.601 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153059698413 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:19:698.609 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:19:698.618 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:19:698.625 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:19:698.636 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:19:698.643 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:19:698.946 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153059698550 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 9 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 13512 calls = 8 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 198 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 32 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 42 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 379, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 90, _iter59->first = sent _iter59->second = 8, ] ] ] 2025-02-10 Mon 02:04:19:698.983 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:19:699.292 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:49878::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:19:699.313 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:49878::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:19:699.357 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:19:699.381 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:19:699.422 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:19:699.431 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Idle 2025-02-10 Mon 02:04:19:699.533 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:19:699.562 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153059699408 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:04:19:699.570 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:19:699.585 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:19:699.613 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:19:700.009 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153059699519 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 9 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 15201 calls = 9 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 198 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 32 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 42 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 379, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 92, _iter59->first = sent _iter59->second = 9, ] ] ] 2025-02-10 Mon 02:04:19:701.333 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:20:595.482 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:20:595.665 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating bgp-router:default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:20:595.719 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-bgp-router controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:20:595.792 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:20:595.810 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:20:595.826 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:20:595.840 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:__link_local__ VN Index 3 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:20:595.853 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:20:595.865 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:20:595.879 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:5, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:default-virtual-network VN Index 1 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:20:595.902 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Starting Bgp Server at 10.0.0.38:179 2025-02-10 Mon 02:04:20:595.948 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.0.0.38:179 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:04:20:595.971 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGP [SYS_DEBUG]: BgpConfigLog: Updated Router ID from 0.0.0.0 to 10.0.0.38 controller/src/bgp/bgp_server.cc 261 2025-02-10 Mon 02:04:20:595.985 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGP [SYS_DEBUG]: BgpConfigLog: Updated Autonomous System from 0 to 64512 controller/src/bgp/bgp_server.cc 285 2025-02-10 Mon 02:04:20:595.994 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGP [SYS_DEBUG]: BgpConfigLog: Updated Local Autonomous System from 0 to 64512 controller/src/bgp/bgp_server.cc 301 2025-02-10 Mon 02:04:20:596.078 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigProtocolUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ AdminDown 0 Local AS 64512 Router ID 10.0.0.38 Address 10.0.0.38 Hold Time 0 Address Families families= [ [ route-target, inet-vpn, e-vpn, erm-vpn, inet6-vpn, ] ] controller/src/bgp/bgp_config_ifmap.cc 2357 2025-02-10 Mon 02:04:20:596.099 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:20:596.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: SANDESH: Send FAILED: 1739153060596048 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:20:596.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:20:596.196 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:597.574 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:597.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:597.600 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:597.685 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:597.700 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:597.713 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:597.725 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:597.734 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:597.745 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:597.756 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:597.765 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:597.775 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:597.785 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:597.794 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:597.841 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:5, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 1 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:20:597.857 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:20:597.874 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153060597806 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network route_distinguisher = 10.0.0.38:5 operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:5, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:04:20:597.887 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:20:598.220 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.ermvpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.250 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.261 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.274 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.mvpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.285 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.294 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.304 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.evpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.323 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.442 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.ermvpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.463 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.474 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.491 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.mvpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.502 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.517 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.518 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.576 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.589 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.602 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.mvpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.533 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.evpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.634 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.646 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.537 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.668 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.738 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.752 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet6.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.763 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.772 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.803 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:20:598.831 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.844 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.854 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.867 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.inet.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.878 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.887 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.898 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.inet6.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:598.908 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:598.917 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:598.936 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 3 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:20:598.948 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:20:598.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153060598782 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ route_distinguisher = 10.0.0.38:4 operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:4, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:04:20:598.971 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:20:598.981 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:20:598.993 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153060598927 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ route_distinguisher = 10.0.0.38:2 operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:2, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:04:20:599.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:20:598.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:599.590 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:599.603 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.evpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:599.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:599.623 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:599.633 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:599.644 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:599.653 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:599.663 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet6.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:599.682 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:599.691 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:599.719 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:20:599.733 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:20:599.767 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153060599700 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network route_distinguisher = 10.0.0.38:3 operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:3, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:04:20:599.777 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:20:599.968 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:599.980 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:599.992 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:600.002 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:600.012 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:600.021 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:600.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:600.040 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:600.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:600.058 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:20:600.067 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:20:600.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:20:600.112 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:20:600.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:20:600.396 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153060600088 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric route_distinguisher = 10.0.0.38:1 operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:1, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:04:20:600.405 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:21:068.137 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:21:068.342 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-bgp-router controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:21:493.630 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:21:493.809 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:21:493.857 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:21:615.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:21:615.381 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:21:615.442 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:053.324 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND Xmpp creating dynamic channel 10.0.0.38:5269::10.0.0.38:45571 controller/src/xmpp/xmpp_server.cc 586 2025-02-10 Mon 02:04:22:056.382 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-10 Mon 02:04:22:057.199 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:5269::10.0.0.38:45571 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:04:22:057.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:058.480 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153062057233 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Idle last_state = Idle last_state_at = 1739153062057215 ] ] 2025-02-10 Mon 02:04:22:058.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:22:058.509 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:057.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.0.0.38 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-10 Mon 02:04:22:060.978 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153062057252 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:061.001 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:061.579 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:061.605 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153062059210 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStart last_event_at = 1739153062059206 ] ] 2025-02-10 Mon 02:04:22:061.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:22:061.622 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:061.634 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153062059219 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Active last_state = Idle last_state_at = 1739153062059217 ] ] 2025-02-10 Mon 02:04:22:061.640 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:22:061.647 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:061.657 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153062059225 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvTcpPassiveOpen last_event_at = 1739153062059223 ] ] 2025-02-10 Mon 02:04:22:061.679 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:22:061.687 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:061.701 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153062059245 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active event = EvTcpPassiveOpen local_port = 5269 remote_port = 45571 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:061.708 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:061.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Create cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 NoFqnSet controller/src/ifmap/ifmap_xmpp.cc 404 2025-02-10 Mon 02:04:22:061.919 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Created controller/src/bgp/bgp_xmpp_channel.cc 530 2025-02-10 Mon 02:04:22:061.942 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV EndOfRib Receive timer scheduled to fire after 300 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2851 2025-02-10 Mon 02:04:22:061.955 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer scheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2875 2025-02-10 Mon 02:04:22:061.997 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:062.009 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153062061746 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] 2025-02-10 Mon 02:04:22:062.016 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:22:062.024 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:062.035 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153062061756 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppOpen last_event_at = 1739153062061755 ] ] 2025-02-10 Mon 02:04:22:062.041 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:22:062.048 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:062.059 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153062061791 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:22:062.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:22:062.077 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:062.088 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153062061797 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Established last_state = Active last_state_at = 1739153062061796 ] ] 2025-02-10 Mon 02:04:22:062.094 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:22:151.318 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:151.437 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-target:target:64512:8000000 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:22:186.770 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:186.968 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-target:attr(default-domain:default-project:dci-network:__default__,target:64512:8000000) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:22:186.994 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:187.012 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:187.085 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:22:187.105 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:22:187.131 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.ermvpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.149 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:187.170 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:187.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.mvpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.199 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:187.208 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:187.218 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.evpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.227 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:187.236 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:187.245 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.254 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:187.263 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:187.272 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet6.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.281 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:187.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:187.300 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.ermvpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.317 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:187.327 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.mvpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.340 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:187.349 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.evpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.358 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:187.367 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.379 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.inet.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:187.388 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet6.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:187.397 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:187.436 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:22:187.451 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:187.470 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153062187406 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ route_distinguisher = 10.0.0.38:4 operation = add_import_rt= [ [ (*_iter24) = target:64512:8000000, ] ] add_export_rt= [ [ (*_iter26) = target:64512:8000000, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:04:22:187.479 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:22:296.075 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:296.216 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-target:target:64512:8000001 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:22:322.772 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:358.941 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:359.105 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-target:attr(default-domain:default-project:dci-network:dci-network,target:64512:8000001) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:22:359.154 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:359.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:359.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:22:359.275 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:22:359.301 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.320 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:359.330 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:359.340 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.mvpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.351 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:359.360 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:359.370 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.evpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.387 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:359.396 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:359.406 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.416 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:359.424 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:359.433 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet6.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.442 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:359.451 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:359.463 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.477 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:359.488 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.mvpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:359.506 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.evpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.515 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:359.528 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.539 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.inet.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:359.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet6.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:359.558 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:359.607 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:359.645 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153062359567 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network route_distinguisher = 10.0.0.38:3 operation = add_import_rt= [ [ (*_iter24) = target:64512:8000001, ] ] add_export_rt= [ [ (*_iter26) = target:64512:8000001, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:04:22:359.656 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:22:359.611 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:22:430.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:430.690 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-target:target:64512:8000002 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:22:500.312 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:500.557 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-target:attr(default-domain:default-project:default-virtual-network:default-virtual-network,target:64512:8000002) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:22:500.601 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:500.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:500.758 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:5, target:64512:7999999, target:64512:8000002, ] ] Export Targets export_rt= [ [ target:64512:8000002, ] ] Virtual Network default-domain:default-project:default-virtual-network VN Index 1 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:22:500.781 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:5, target:64512:7999999, target:64512:8000002, ] ] Export Targets export_rt= [ [ target:64512:8000002, ] ] Virtual Network default-domain:default-project:default-virtual-network VN Index 1 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:22:500.811 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:500.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:500.840 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:500.850 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:500.860 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:500.869 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:500.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:500.890 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:500.899 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:500.908 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:500.922 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:500.931 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:500.941 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:500.950 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:500.959 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:500.971 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:500.985 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:500.995 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:501.006 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:501.015 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:501.024 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:501.033 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:501.044 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:501.054 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:501.068 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:501.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:5, target:64512:7999999, target:64512:8000002, ] ] Export Targets export_rt= [ [ target:64512:8000002, ] ] VN Index 1 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:22:501.126 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:501.147 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: SANDESH: Send FAILED: 1739153062501079 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network route_distinguisher = 10.0.0.38:5 operation = add_import_rt= [ [ (*_iter24) = target:64512:8000002, ] ] add_export_rt= [ [ (*_iter26) = target:64512:8000002, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:04:22:501.155 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:22:611.022 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:611.149 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-target:target:64512:8000003 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:22:680.861 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:681.019 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-target:attr(default-domain:default-project:ip-fabric:ip-fabric,target:64512:8000003) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:22:682.181 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:682.209 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:682.289 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:22:682.319 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:04:22:682.344 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:682.362 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:682.372 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:682.383 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:682.393 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:682.402 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:682.411 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:682.421 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:682.430 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:682.440 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:682.449 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:682.458 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:682.467 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:682.480 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:04:22:682.489 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:04:22:682.499 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:682.512 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:682.522 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:682.532 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:682.541 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:683.092 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:683.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:683.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:683.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:04:22:683.142 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:04:22:683.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:04:22:683.199 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:22:683.248 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153062683153 [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric route_distinguisher = 10.0.0.38:1 operation = add_import_rt= [ [ (*_iter24) = target:64512:8000003, ] ] add_export_rt= [ [ (*_iter26) = target:64512:8000003, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:04:22:683.258 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceCollector 2025-02-10 Mon 02:04:22:913.835 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:22:914.029 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:22:914.070 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:22:974.712 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:037.310 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:064.870 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:04:23:440.439 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:440.933 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:23:440.982 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:23:499.854 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:500.066 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:23:500.107 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:23:565.718 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:565.931 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:23:565.990 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:23:646.166 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:646.898 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:23:646.951 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:23:713.816 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:714.047 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:23:714.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:23:809.416 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:809.580 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:23:809.617 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:23:886.723 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:886.895 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:23:886.953 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:23:968.956 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:23:969.171 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:23:969.228 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:045.637 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:045.814 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:045.854 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:065.063 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:04:24:111.979 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:112.141 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:112.180 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:183.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:184.859 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:184.935 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:257.773 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:258.014 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:258.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:377.575 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:377.786 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:377.842 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:449.749 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:449.922 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:449.965 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:518.387 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:518.602 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:518.661 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:585.464 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:585.703 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:585.745 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:661.437 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:661.591 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:661.630 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:699.526 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:24:699.789 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:24:699.956 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:24:699.986 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153064699628 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:24:699.995 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:24:700.004 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:24:700.382 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153064699932 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 9 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 15201 calls = 9 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 231 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 71 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 685, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 114, _iter59->first = sent _iter59->second = 9, ] ] ] 2025-02-10 Mon 02:04:24:700.408 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:24:702.048 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:50126::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:24:702.084 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:50126::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:24:702.101 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:50126::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:24:702.163 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:24:702.190 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:24:702.233 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit 2025-02-10 Mon 02:04:24:702.252 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 10 2025-02-10 Mon 02:04:24:702.395 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:24:702.407 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:24:702.431 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153064702216 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:24:702.439 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:24:702.447 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:24:702.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:24:702.465 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:24:702.471 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:24:702.867 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153064702375 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 10 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 15201 calls = 9 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 231 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 71 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 686, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 116, _iter59->first = sent _iter59->second = 9, ] ] ] 2025-02-10 Mon 02:04:24:702.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:24:703.802 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:50126::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:24:703.820 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:50126::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:24:703.867 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:24:703.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:24:703.959 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:24:703.967 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Idle 2025-02-10 Mon 02:04:24:704.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:24:704.105 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153064703945 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:24:704.113 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:24:704.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:24:704.148 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:24:704.529 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153064704061 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 10 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 16892 calls = 10 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 231 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 71 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 686, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 118, _iter59->first = sent _iter59->second = 10, ] ] ] 2025-02-10 Mon 02:04:24:704.556 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:24:735.626 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:735.799 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:735.837 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:799.994 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:800.147 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:800.186 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:880.439 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:880.635 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:880.736 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:24:945.199 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:24:945.368 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:24:945.413 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:25:015.428 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:25:015.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:25:015.930 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:25:065.217 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:04:25:085.329 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:25:085.531 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:04:25:085.590 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798429820672, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:04:25:974.871 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:26:066.119 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798421423872, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:04:26:861.717 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:27:066.281 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:04:27:719.190 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:44628 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:04:27:778.724 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:04:28:066.439 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:04:29:068.283 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:04:29:704.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:29:704.303 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:29:704.462 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:29:704.490 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153069704151 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:29:704.501 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:29:704.509 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:29:706.662 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:52794::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:29:706.703 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:52794::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:29:706.716 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:52794::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:29:707.125 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153069704435 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 10 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 16892 calls = 10 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 713, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 120, _iter59->first = sent _iter59->second = 10, ] ] ] 2025-02-10 Mon 02:04:29:707.159 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:29:707.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:29:707.181 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:29:707.210 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ClientInit 2025-02-10 Mon 02:04:29:707.227 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 11 2025-02-10 Mon 02:04:29:707.323 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:29:707.332 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:29:707.354 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153069707202 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:29:707.364 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:29:707.373 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:29:707.380 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:29:707.397 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:29:707.403 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:29:707.767 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153069707310 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 11 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 16892 calls = 10 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 714, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 122, _iter59->first = sent _iter59->second = 10, ] ] ] 2025-02-10 Mon 02:04:29:707.790 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:29:708.267 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:52794::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:29:708.291 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:52794::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:29:708.347 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:29:708.381 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:29:708.433 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:29:708.455 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Idle 2025-02-10 Mon 02:04:29:708.612 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:29:708.651 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153069708415 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:29:708.717 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:29:708.730 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:29:708.763 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:29:709.448 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153069708579 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 11 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 18583 calls = 11 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 11 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 714, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 124, _iter59->first = sent _iter59->second = 11, ] ] ] 2025-02-10 Mon 02:04:29:709.496 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:30:068.436 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:04:31:068.773 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:04:32:061.125 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Event: Tcp Connection Closed peer ip: 10.0.0.38 ( cn-jenkins-deploy-platform-juju-os-472-1 ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-02-10 Mon 02:04:32:061.317 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:061.319 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State NONE, MembershipState: NONE, MembershipReqPending: 0, CloseAgain?: No: Enqueued event CLOSE, graceful 0, family unspecified controller/src/bgp/peer_close_manager.cc 144 2025-02-10 Mon 02:04:32:061.322 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Destroy cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_xmpp.cc 429 2025-02-10 Mon 02:04:32:061.733 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State NONE, MembershipState: NONE, MembershipReqPending: 0, CloseAgain?: No: Move to state DELETE controller/src/bgp/peer_close_manager.cc 300 2025-02-10 Mon 02:04:32:061.751 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 0, CloseAgain?: No: Enqueued event MEMBERSHIP_REQUEST, graceful 1, family unspecified controller/src/bgp/peer_close_manager.cc 144 2025-02-10 Mon 02:04:32:061.765 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 1, CloseAgain?: No: MembershipRequestCallback controller/src/bgp/peer_close_manager.cc 531 2025-02-10 Mon 02:04:32:061.776 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 0, CloseAgain?: No: Move to state NONE controller/src/bgp/peer_close_manager.cc 542 2025-02-10 Mon 02:04:32:061.803 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapChannelUnregisterMessage: Unregistering config peer for channel cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_xmpp.cc 465 2025-02-10 Mon 02:04:32:061.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Deleted controller/src/bgp/bgp_xmpp_channel.cc 549 2025-02-10 Mon 02:04:32:061.909 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvStop in state Idle controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:04:32:061.937 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : cn-jenkins-deploy-platform-juju-os-472-1 controller/src/xmpp/xmpp_connection.cc 734 2025-02-10 Mon 02:04:32:061.365 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153072061246 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvTcpClose last_event_at = 1739153072061238 ] ] 2025-02-10 Mon 02:04:32:062.011 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:32:062.022 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:062.037 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153072061402 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Established next_state = Idle event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:32:062.044 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:32:062.053 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:062.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153072061410 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Idle last_state = Established last_state_at = 1739153072061407 ] ] 2025-02-10 Mon 02:04:32:062.072 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:32:062.079 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:062.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153072061414 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:32:062.095 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:32:062.103 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:062.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153072061417 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 flap_info= [ flap_count = 1 flap_time = 1739153072061416 ] ] 2025-02-10 Mon 02:04:32:062.120 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:32:062.128 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:062.137 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153072061854 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 deleted = 1 ] 2025-02-10 Mon 02:04:32:062.143 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:32:062.154 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:062.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153072061881 [SYS_NOTICE]: PeerStatsUve: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 deleted = 1 encoding = ] 2025-02-10 Mon 02:04:32:062.181 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: PeerStatsUve 2025-02-10 Mon 02:04:32:062.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:062.199 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153072061900 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153072061893 ] ] 2025-02-10 Mon 02:04:32:062.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:32:528.983 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:529.072 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153072528821 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 145 dequeues = 145 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 11 dequeues = 11 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 11 dequeues = 11 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 190 dequeues = 190 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739153069708453 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739153072062187 ] max_sm_queue_count = 7 ] 2025-02-10 Mon 02:04:32:529.086 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:32:529.095 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:529.532 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153072528946 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 11 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 18583 calls = 11 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 11 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 727, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 134, _iter59->first = sent _iter59->second = 11, ] ] ] 2025-02-10 Mon 02:04:32:529.563 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:32:529.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:530.047 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153072529611 [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:__link_local__ raw_ipv4_stats= [ [ _iter64->first = default-domain:default-project:__link_local__:__link_local__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ipv6_stats= [ [ _iter65->first = default-domain:default-project:__link_local__:__link_local__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_evpn_stats= [ [ _iter69->first = default-domain:default-project:__link_local__:__link_local__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ermvpn_stats= [ [ _iter70->first = default-domain:default-project:__link_local__:__link_local__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_mvpn_stats= [ [ _iter71->first = default-domain:default-project:__link_local__:__link_local__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] ] 2025-02-10 Mon 02:04:32:530.062 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceStats 2025-02-10 Mon 02:04:32:530.072 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:530.107 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153072529626 [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:dci-network raw_ipv4_stats= [ [ _iter64->first = default-domain:default-project:dci-network:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ipv6_stats= [ [ _iter65->first = default-domain:default-project:dci-network:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_evpn_stats= [ [ _iter69->first = default-domain:default-project:dci-network:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ermvpn_stats= [ [ _iter70->first = default-domain:default-project:dci-network:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_mvpn_stats= [ [ _iter71->first = default-domain:default-project:dci-network:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] ] 2025-02-10 Mon 02:04:32:530.116 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceStats 2025-02-10 Mon 02:04:32:530.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:530.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153072529633 [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:dci-network raw_ipv4_stats= [ [ _iter64->first = default-domain:default-project:dci-network:dci-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ipv6_stats= [ [ _iter65->first = default-domain:default-project:dci-network:dci-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_evpn_stats= [ [ _iter69->first = default-domain:default-project:dci-network:dci-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ermvpn_stats= [ [ _iter70->first = default-domain:default-project:dci-network:dci-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_mvpn_stats= [ [ _iter71->first = default-domain:default-project:dci-network:dci-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] ] 2025-02-10 Mon 02:04:32:530.168 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceStats 2025-02-10 Mon 02:04:32:530.175 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:530.209 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153072529641 [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:default-virtual-network raw_ipv4_stats= [ [ _iter64->first = default-domain:default-project:default-virtual-network:default-virtual-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ipv6_stats= [ [ _iter65->first = default-domain:default-project:default-virtual-network:default-virtual-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_evpn_stats= [ [ _iter69->first = default-domain:default-project:default-virtual-network:default-virtual-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ermvpn_stats= [ [ _iter70->first = default-domain:default-project:default-virtual-network:default-virtual-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_mvpn_stats= [ [ _iter71->first = default-domain:default-project:default-virtual-network:default-virtual-network [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] ] 2025-02-10 Mon 02:04:32:530.218 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceStats 2025-02-10 Mon 02:04:32:530.225 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:530.271 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153072529654 [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:ip-fabric raw_ipv4_stats= [ [ _iter64->first = default-domain:default-project:ip-fabric:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ipv6_stats= [ [ _iter65->first = default-domain:default-project:ip-fabric:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_inetvpn_stats= [ [ _iter66->first = default-domain:default-project:ip-fabric:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_inet6vpn_stats= [ [ _iter67->first = default-domain:default-project:ip-fabric:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_rtarget_stats= [ [ _iter68->first = default-domain:default-project:ip-fabric:__default__ [ prefixes = 1 primary_paths = 1 secondary_paths = 0 infeasible_paths = 0 total_paths = 1 ], ] ] raw_evpn_stats= [ [ _iter69->first = default-domain:default-project:ip-fabric:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ermvpn_stats= [ [ _iter70->first = default-domain:default-project:ip-fabric:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_mvpn_stats= [ [ _iter71->first = default-domain:default-project:ip-fabric:__default__ [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] ] 2025-02-10 Mon 02:04:32:531.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceStats 2025-02-10 Mon 02:04:32:531.228 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:531.271 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153072529660 [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:ip-fabric raw_ipv4_stats= [ [ _iter64->first = default-domain:default-project:ip-fabric:ip-fabric [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ipv6_stats= [ [ _iter65->first = default-domain:default-project:ip-fabric:ip-fabric [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_evpn_stats= [ [ _iter69->first = default-domain:default-project:ip-fabric:ip-fabric [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_ermvpn_stats= [ [ _iter70->first = default-domain:default-project:ip-fabric:ip-fabric [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] raw_mvpn_stats= [ [ _iter71->first = default-domain:default-project:ip-fabric:ip-fabric [ prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ], ] ] ] 2025-02-10 Mon 02:04:32:531.281 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: RoutingInstanceStats 2025-02-10 Mon 02:04:32:531.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:32:531.341 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153072529727 [SYS_NOTICE]: BGPRouterInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 router_id = 10.0.0.38 local_asn = 64512 global_asn = 64512 admin_down = 0 uptime = 1739153072529575 output_queue_depth = 0 num_bgp_peer = 0 num_up_bgp_peer = 0 num_deleting_bgp_peer = 0 num_bgpaas_peer = 0 num_up_bgpaas_peer = 0 num_deleting_bgpaas_peer = 0 num_xmpp_peer = 0 num_up_xmpp_peer = 0 num_deleting_xmpp_peer = 0 num_routing_instance = 6 num_deleted_routing_instance = 0 num_service_chains = 0 num_down_service_chains = 0 num_static_routes = 0 num_down_static_routes = 0 build_info = {"build-info":[{"build-version":"nightly","build-time":"2025-02-10 00:48:15.963170","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7708-1.novalocal","build-id":"unknown","build-number":"unknown"}]} bgp_router_ip_list= [ [ (*_iter24) = 10.0.0.38, ] ] bgp_config_peer_list= [ [ ] ] bgp_oper_peer_list= [ [ ] ] ifmap_server_info= [ num_peer_clients = 0 ] db_conn_info= [ cluster = 10.0.0.38 connection_status = 1 connection_status_change_at = 2025-Feb-10 02:04:12.899804 ] amqp_conn_info= [ url = amqp://********:********@10.0.0.38:5673 connection_status = 1 connection_status_change_at = 2025-Feb-10 02:03:47.581999 ] ] 2025-02-10 Mon 02:04:32:531.355 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: BGPRouterInfo 2025-02-10 Mon 02:04:34:708.565 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:34:708.823 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:34:709.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:34:709.032 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153074708627 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:34:709.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:34:709.058 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:34:713.370 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153074708975 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 11 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 18583 calls = 11 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 11 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 727, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 143, _iter59->first = sent _iter59->second = 11, ] ] ] 2025-02-10 Mon 02:04:34:713.427 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:34:714.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:53040::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:34:714.198 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:53040::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:34:714.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:53040::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:34:714.263 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:34:714.273 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:34:714.305 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ClientInit 2025-02-10 Mon 02:04:34:714.325 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 12 2025-02-10 Mon 02:04:34:716.956 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:34:716.977 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:34:717.004 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: SANDESH: Send FAILED: 1739153074714297 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:34:717.013 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:34:717.022 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:34:717.029 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:34:717.043 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:34:717.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:34:717.491 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: SANDESH: Send FAILED: 1739153074716927 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 12 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 18583 calls = 11 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 41 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 11 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 19 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 728, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 145, _iter59->first = sent _iter59->second = 11, ] ] ] 2025-02-10 Mon 02:04:34:717.519 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798513399552, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:34:718.332 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:53040::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:34:718.346 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:53040::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:34:718.376 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:34:718.387 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:34:718.429 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:34:718.436 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Idle 2025-02-10 Mon 02:04:34:718.564 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:34:718.589 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153074718413 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:34:718.597 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:34:718.606 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:34:718.630 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:34:722.615 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153074718547 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 12 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 20274 calls = 12 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 41 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 19 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 728, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 147, _iter59->first = sent _iter59->second = 12, ] ] ] 2025-02-10 Mon 02:04:34:722.675 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:36:686.471 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND Xmpp creating dynamic channel 10.0.0.38:5269::10.0.0.38:43421 controller/src/xmpp/xmpp_server.cc 586 2025-02-10 Mon 02:04:36:686.525 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-10 Mon 02:04:36:686.562 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:5269::10.0.0.38:43421 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:04:36:686.679 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.0.0.38 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-10 Mon 02:04:36:686.733 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:686.751 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153076686642 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Idle last_state = Idle last_state_at = 1739153076686628 ] ] 2025-02-10 Mon 02:04:36:686.759 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:36:686.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:686.781 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153076686656 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:686.788 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:686.795 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:686.806 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153076686702 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStart last_event_at = 1739153076686700 ] ] 2025-02-10 Mon 02:04:36:686.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:36:686.819 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:686.829 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153076686709 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Active last_state = Idle last_state_at = 1739153076686705 ] ] 2025-02-10 Mon 02:04:36:686.841 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:36:686.848 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:686.858 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153076686713 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvTcpPassiveOpen last_event_at = 1739153076686712 ] ] 2025-02-10 Mon 02:04:36:686.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:36:686.870 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:686.883 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153076686725 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active event = EvTcpPassiveOpen local_port = 5269 remote_port = 43421 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:686.889 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:687.882 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Create cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 NoFqnSet controller/src/ifmap/ifmap_xmpp.cc 404 2025-02-10 Mon 02:04:36:687.926 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Created controller/src/bgp/bgp_xmpp_channel.cc 530 2025-02-10 Mon 02:04:36:687.943 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV EndOfRib Receive timer scheduled to fire after 300 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2851 2025-02-10 Mon 02:04:36:687.959 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer scheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2875 2025-02-10 Mon 02:04:36:687.978 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:687.997 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: SANDESH: Send FAILED: 1739153076687829 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] 2025-02-10 Mon 02:04:36:688.008 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:36:688.019 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:691.531 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: SANDESH: Send FAILED: 1739153076687838 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppOpen last_event_at = 1739153076687837 ] ] 2025-02-10 Mon 02:04:36:691.564 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:36:691.579 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:691.603 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: SANDESH: Send FAILED: 1739153076687863 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:04:36:691.611 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:04:36:691.619 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:36:691.631 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: SANDESH: Send FAILED: 1739153076687868 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Established last_state = Active last_state_at = 1739153076687867 ] ] 2025-02-10 Mon 02:04:36:691.637 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:04:37:689.514 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib marker sent controller/src/bgp/bgp_xmpp_channel.cc 2906 2025-02-10 Mon 02:04:39:718.549 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:39:719.073 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:39:719.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:39:719.388 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153079718612 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:39:719.398 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:39:719.408 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:39:719.930 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153079719308 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 12 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 20274 calls = 12 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 737, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 159, _iter59->first = sent _iter59->second = 12, ] ] ] 2025-02-10 Mon 02:04:39:719.969 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:39:722.115 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:47410::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:39:722.142 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:47410::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:39:722.151 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:47410::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:39:722.216 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:39:722.242 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:39:722.280 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit 2025-02-10 Mon 02:04:39:722.299 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 13 2025-02-10 Mon 02:04:39:722.410 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:39:722.420 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:39:722.443 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153079722271 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:39:722.452 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:39:722.460 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:39:722.467 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:39:722.486 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:39:722.492 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:39:722.955 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153079722397 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 13 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 20274 calls = 12 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 738, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 161, _iter59->first = sent _iter59->second = 12, ] ] ] 2025-02-10 Mon 02:04:39:722.983 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:39:724.793 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:47410::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:39:724.817 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:47410::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:39:724.858 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:39:724.870 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:39:724.912 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:39:724.920 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Idle 2025-02-10 Mon 02:04:39:725.032 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:39:725.058 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153079724896 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:39:725.110 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:39:725.121 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:39:725.150 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:39:725.791 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153079725017 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 13 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 21965 calls = 13 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 45 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 13 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 738, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 163, _iter59->first = sent _iter59->second = 13, ] ] ] 2025-02-10 Mon 02:04:39:725.824 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:44:725.013 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:44:725.245 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:44:725.447 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:44:725.480 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153084725084 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:44:725.489 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:44:725.504 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:44:726.008 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: SANDESH: Send FAILED: 1739153084725413 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 13 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 21965 calls = 13 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 46 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 13 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 45 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 738, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 165, _iter59->first = sent _iter59->second = 13, ] ] ] 2025-02-10 Mon 02:04:44:726.043 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798387836672, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:44:728.508 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:47608::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:44:728.530 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:47608::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:44:728.538 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:47608::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:44:728.583 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:44:728.598 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:44:728.640 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ClientInit 2025-02-10 Mon 02:04:44:728.682 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 14 2025-02-10 Mon 02:04:44:728.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:44:728.878 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:44:728.907 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153084728630 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:44:728.923 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:44:728.934 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:44:728.944 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:44:728.959 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:44:728.968 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:44:729.710 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153084728838 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 14 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 21965 calls = 13 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 13 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 46 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 22 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 739, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 167, _iter59->first = sent _iter59->second = 13, ] ] ] 2025-02-10 Mon 02:04:44:729.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:44:743.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:47608::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:44:743.059 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:47608::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:44:743.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:44:743.140 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:44:743.200 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:44:743.218 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Idle 2025-02-10 Mon 02:04:44:743.421 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:44:743.458 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153084743178 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:44:743.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:44:743.479 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:44:743.514 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:44:743.976 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153084743390 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 14 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 23656 calls = 14 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 48 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 14 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 22 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 739, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 169, _iter59->first = sent _iter59->second = 14, ] ] ] 2025-02-10 Mon 02:04:44:744.006 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:49:743.338 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:49:743.573 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:49:743.763 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:49:743.802 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153089743411 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:49:743.811 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:49:743.819 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:49:744.287 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153089743737 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 14 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 23656 calls = 14 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 49 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 14 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 48 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 22 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 739, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 171, _iter59->first = sent _iter59->second = 14, ] ] ] 2025-02-10 Mon 02:04:49:745.095 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:49:747.098 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:58016::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:49:747.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:58016::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:49:747.140 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:58016::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:49:747.215 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:49:747.243 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:49:747.293 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ClientInit 2025-02-10 Mon 02:04:49:747.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 15 2025-02-10 Mon 02:04:49:747.436 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:49:747.447 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:49:747.471 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153089747284 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:49:747.479 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:49:747.488 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:49:747.495 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:49:747.522 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:49:747.529 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:49:747.994 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153089747421 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 15 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 23656 calls = 14 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 50 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 14 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 49 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 740, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 173, _iter59->first = sent _iter59->second = 14, ] ] ] 2025-02-10 Mon 02:04:49:748.029 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:49:748.532 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:58016::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:49:748.552 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:58016::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:49:748.612 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:49:748.639 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:49:748.774 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:49:748.786 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Idle 2025-02-10 Mon 02:04:49:748.903 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:49:748.930 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153089748754 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:49:748.938 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:49:748.947 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:49:748.976 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:49:749.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153089748884 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 15 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 25347 calls = 15 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 51 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 15 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 50 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 740, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 175, _iter59->first = sent _iter59->second = 15, ] ] ] 2025-02-10 Mon 02:04:49:749.461 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:49:765.169 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:52182 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:04:54:749.170 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:54:749.547 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:54:749.785 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:54:749.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153094749242 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:54:749.934 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:54:749.946 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:54:750.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153094749753 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 15 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 25347 calls = 15 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 52 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 15 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 51 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 24 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 741, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 177, _iter59->first = sent _iter59->second = 15, ] ] ] 2025-02-10 Mon 02:04:54:750.459 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:54:752.701 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:58292::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:54:752.729 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:58292::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:54:752.737 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:58292::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:54:752.800 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:54:752.827 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:54:752.881 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit 2025-02-10 Mon 02:04:54:752.905 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 16 2025-02-10 Mon 02:04:54:753.066 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:54:753.082 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:54:753.115 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153094752867 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:54:753.127 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:54:753.139 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:54:753.148 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:54:753.160 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:54:753.166 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:54:753.605 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: SANDESH: Send FAILED: 1739153094753044 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 16 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 25347 calls = 15 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 53 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 15 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 52 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 742, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 179, _iter59->first = sent _iter59->second = 15, ] ] ] 2025-02-10 Mon 02:04:54:754.097 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798521796352, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:54:755.834 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:58292::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:54:755.862 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:58292::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:54:756.734 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:54:756.755 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:54:756.818 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:54:756.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Idle 2025-02-10 Mon 02:04:54:756.991 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:54:757.018 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: SANDESH: Send FAILED: 1739153094756787 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:54:757.026 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:54:757.036 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:54:757.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:54:757.568 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: SANDESH: Send FAILED: 1739153094756964 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 16 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 27038 calls = 16 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 54 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 53 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 742, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 181, _iter59->first = sent _iter59->second = 16, ] ] ] 2025-02-10 Mon 02:04:54:757.608 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:59:756.952 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:04:59:757.185 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:04:59:757.348 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:59:757.378 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153099757018 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:59:757.387 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:59:757.395 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:04:59:757.866 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153099757330 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 16 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 27038 calls = 16 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 55 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 54 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 742, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 183, _iter59->first = sent _iter59->second = 16, ] ] ] 2025-02-10 Mon 02:04:59:757.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:04:59:759.975 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:48682::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:04:59:760.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:48682::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:04:59:760.008 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:48682::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:04:59:760.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:04:59:760.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:04:59:760.149 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: ClientInit 2025-02-10 Mon 02:04:59:760.167 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 17 2025-02-10 Mon 02:04:59:760.282 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:59:760.292 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:04:59:760.315 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: SANDESH: Send FAILED: 1739153099760139 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:59:760.323 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:04:59:760.342 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:59:760.349 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:04:59:760.362 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:04:59:760.368 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:04:59:760.834 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: SANDESH: Send FAILED: 1739153099760268 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 17 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 27038 calls = 16 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 56 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 55 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 26 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 743, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 185, _iter59->first = sent _iter59->second = 16, ] ] ] 2025-02-10 Mon 02:04:59:760.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798392035072, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:04:59:761.329 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:48682::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:04:59:761.349 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:48682::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:04:59:761.407 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:04:59:761.429 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:04:59:761.468 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:04:59:761.476 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Idle 2025-02-10 Mon 02:04:59:761.580 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:59:761.616 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153099761453 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:04:59:761.635 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:04:59:761.644 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:04:59:761.676 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:04:59:762.103 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: SANDESH: Send FAILED: 1739153099761566 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 17 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 28729 calls = 17 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 57 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 17 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 56 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 26 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 743, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 187, _iter59->first = sent _iter59->second = 17, ] ] ] 2025-02-10 Mon 02:04:59:762.130 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798425622272, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:02:530.376 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:02:530.476 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153102530070 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 16 dequeues = 16 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 206 dequeues = 206 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 17 dequeues = 17 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 17 dequeues = 17 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 275 dequeues = 275 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739153099761475 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739153099761674 ] max_sm_queue_count = 7 ] 2025-02-10 Mon 02:05:02:530.500 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:02:530.511 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:02:531.068 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153102530320 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 17 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 28729 calls = 17 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 58 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 17 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 57 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 26 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 743, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 189, _iter59->first = sent _iter59->second = 17, ] ] ] 2025-02-10 Mon 02:05:02:531.100 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:04:761.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:04:761.858 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:04:762.035 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:04:762.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153104761690 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:05:04:762.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:04:762.090 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:04:762.727 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153104762008 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 17 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 28729 calls = 17 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 58 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 17 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 59 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 26 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 743, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 191, _iter59->first = sent _iter59->second = 17, ] ] ] 2025-02-10 Mon 02:05:04:762.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:04:764.834 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:48920::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:04:764.856 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:48920::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:04:764.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:48920::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:04:764.931 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:04:764.961 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:04:765.010 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ClientInit 2025-02-10 Mon 02:05:04:765.033 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 18 2025-02-10 Mon 02:05:04:765.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:04:765.203 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:04:765.236 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153104765000 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:05:04:765.258 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:04:765.271 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:04:765.281 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:04:765.297 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:04:765.307 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:04:766.115 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153104765169 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 18 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 28729 calls = 17 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 59 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 17 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 60 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 744, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 193, _iter59->first = sent _iter59->second = 17, ] ] ] 2025-02-10 Mon 02:05:04:766.152 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:04:766.676 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:48920::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:04:766.695 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:48920::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:04:766.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:04:766.752 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:04:767.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:05:04:767.025 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Idle 2025-02-10 Mon 02:05:04:767.138 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:04:767.165 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153104766784 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:05:04:767.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:04:767.182 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:04:767.207 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:04:767.642 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153104767120 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 18 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 30420 calls = 18 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 60 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 18 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 61 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 744, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 195, _iter59->first = sent _iter59->second = 18, ] ] ] 2025-02-10 Mon 02:05:04:768.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:09:767.380 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:09:767.663 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:09:767.851 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:09:767.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153109767493 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:05:09:767.889 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:09:767.898 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:09:768.463 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: SANDESH: Send FAILED: 1739153109767821 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 18 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 30420 calls = 18 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 61 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 18 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 62 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 744, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 197, _iter59->first = sent _iter59->second = 18, ] ] ] 2025-02-10 Mon 02:05:09:769.381 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798517597952, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:09:771.414 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:46198::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:09:771.437 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:46198::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:09:771.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:46198::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:09:771.845 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:09:771.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:09:771.899 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit 2025-02-10 Mon 02:05:09:771.912 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 19 2025-02-10 Mon 02:05:09:772.025 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:09:772.035 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:09:772.057 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153109771891 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:05:09:772.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:09:772.074 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:09:772.081 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:09:772.092 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:09:772.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:09:772.599 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153109772011 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 19 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 30420 calls = 18 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 62 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 18 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 63 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 28 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 745, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 199, _iter59->first = sent _iter59->second = 18, ] ] ] 2025-02-10 Mon 02:05:09:772.632 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:09:773.258 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:46198::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:09:773.278 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:46198::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:09:773.355 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:09:773.389 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:09:773.444 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:05:09:773.457 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Idle 2025-02-10 Mon 02:05:09:773.642 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:09:773.690 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: SANDESH: Send FAILED: 1739153109773422 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:05:09:773.702 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:09:773.714 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:09:773.750 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:09:774.557 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: SANDESH: Send FAILED: 1739153109773612 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 19 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 32111 calls = 19 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 63 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 19 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 64 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 28 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 745, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 201, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-02-10 Mon 02:05:09:774.604 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798400431872, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:14:773.577 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:14:774.296 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:14:774.437 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:14:774.469 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153114774082 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:05:14:774.478 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:14:774.487 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:14:774.942 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153114774415 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 19 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 32111 calls = 19 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 64 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 19 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 65 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 28 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 745, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 203, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-02-10 Mon 02:05:14:774.977 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:14:776.397 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:46380::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:14:776.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:46380::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:14:776.434 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:46380::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:14:776.489 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:14:776.513 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:14:776.546 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit 2025-02-10 Mon 02:05:14:776.560 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 20 2025-02-10 Mon 02:05:14:776.691 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:14:776.702 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:14:776.725 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153114776539 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:05:14:776.733 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:14:776.741 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:14:776.748 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:14:776.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:14:776.871 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:14:777.296 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: SANDESH: Send FAILED: 1739153114776677 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 20 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 32111 calls = 19 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 65 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 19 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 66 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 29 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 746, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 205, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-02-10 Mon 02:05:14:777.329 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798404630272, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:14:777.829 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:46380::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:14:777.846 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:46380::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:14:777.892 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:14:777.919 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:14:777.960 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:05:14:777.968 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Idle 2025-02-10 Mon 02:05:14:778.075 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:14:778.101 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153114777944 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-10 Mon 02:05:14:778.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:14:778.118 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:14:778.145 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:14:778.589 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153114778061 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 20 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 33802 calls = 20 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 240 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 66 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 20 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 67 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 29 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 746, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 207, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-02-10 Mon 02:05:14:778.625 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:19:555.551 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.38:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-02-10 Mon 02:05:19:556.542 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:19:556.582 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: SANDESH: Send FAILED: 1739153119555612 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-02-10 Mon 02:05:19:556.592 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798434019072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:19:556.612 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-02-10 Mon 02:05:19:556.625 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-02-10 Mon 02:05:19:556.850 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.38:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-02-10 Mon 02:05:19:778.094 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:19:789.279 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:19:789.459 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:19:789.491 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153119789043 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-02-10 Mon 02:05:19:789.499 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:19:789.509 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:19:789.971 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: SANDESH: Send FAILED: 1739153119789432 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 20 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 33802 calls = 20 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 242 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 68 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 20 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 68 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 29 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 750, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 210, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-02-10 Mon 02:05:19:790.001 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798396233472, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:19:791.913 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43530::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:19:791.941 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:43530::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:19:791.950 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:43530::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:19:792.018 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:19:792.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:19:792.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit 2025-02-10 Mon 02:05:19:792.107 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 21 2025-02-10 Mon 02:05:19:792.330 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:19:792.344 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:19:792.369 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153119792080 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-02-10 Mon 02:05:19:792.377 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:19:792.386 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:19:792.393 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:19:792.405 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:19:792.412 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:19:792.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153119792226 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 21 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 33802 calls = 20 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 242 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 69 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 20 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 69 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 30 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 751, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 212, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-02-10 Mon 02:05:19:792.920 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:19:793.708 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:43530::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:19:793.727 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:43530::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:19:794.012 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:19:794.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:19:794.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:05:19:794.097 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Idle 2025-02-10 Mon 02:05:19:794.207 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:19:794.232 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153119794074 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-02-10 Mon 02:05:19:794.240 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:19:794.248 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:19:794.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:19:794.733 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: SANDESH: Send FAILED: 1739153119794193 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 21 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 35493 calls = 21 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 242 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 70 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 21 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 70 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 30 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 751, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 214, _iter59->first = sent _iter59->second = 21, ] ] ] 2025-02-10 Mon 02:05:19:794.765 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798408828672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:24:557.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798525994752, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.38:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-02-10 Mon 02:05:24:794.494 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:24:794.763 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:24:794.909 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:24:794.939 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153124794567 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-02-10 Mon 02:05:24:794.948 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:24:794.957 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:24:795.390 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: SANDESH: Send FAILED: 1739153124794881 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 21 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 35493 calls = 21 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 242 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 71 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 21 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 71 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 30 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 752, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 216, _iter59->first = sent _iter59->second = 21, ] ] ] 2025-02-10 Mon 02:05:24:795.423 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798417225472, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:24:797.593 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43722::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:24:797.618 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:43722::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:24:797.626 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:43722::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:24:797.927 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:24:797.940 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:24:797.974 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit 2025-02-10 Mon 02:05:24:797.987 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 22 2025-02-10 Mon 02:05:24:798.096 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:24:798.105 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:24:798.128 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153124797966 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-02-10 Mon 02:05:24:798.135 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:24:798.143 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:24:798.150 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:24:798.167 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:24:798.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:24:798.585 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: SANDESH: Send FAILED: 1739153124798082 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 22 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 35493 calls = 21 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 242 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 72 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 21 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 72 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 31 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 753, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 218, _iter59->first = sent _iter59->second = 21, ] ] ] 2025-02-10 Mon 02:05:24:798.612 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798509201152, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:24:799.876 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:43722::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:24:799.896 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: 10.0.0.38:43722::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:24:799.956 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:24:799.986 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:24:800.029 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:05:24:800.039 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Idle 2025-02-10 Mon 02:05:24:800.179 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:24:800.236 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153124800014 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-02-10 Mon 02:05:24:800.256 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:24:800.267 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:24:800.294 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:24:800.760 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: SANDESH: Send FAILED: 1739153124800163 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 22 pid = 1 http_port = 8083 start_time = 1739153012523512 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 37184 calls = 22 average_bytes = 1690 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = BGPRouterInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = BgpConfigProtocolUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 242 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrWarning [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 73 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCollector [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceStats [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceTableCreateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RoutingInstanceUpdateLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprRegTableLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = RprTableJoinLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 190 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 22 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 73 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 31 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 753, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 220, _iter59->first = sent _iter59->second = 22, ] ] ] 2025-02-10 Mon 02:05:24:800.789 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798413027072, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:28:691.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 139798684059776, Pid 1]: Control-Node Terminated: Received terminating signal 15 2025-02-10 Mon 02:05:30:517.351 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2025-02-10 Mon 02:05:30:517.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-02-10 Mon 02:05:30:520.096 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ ] ] Export Targets export_rt= [ [ ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:05:30:520.186 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:30:520.210 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.l3vpn.0 Family inet-vpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:05:30:520.223 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.l3vpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:30:520.245 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet6-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:30:520.253 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.l3vpn-inet6.0 Family inet6-vpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:05:30:520.263 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.l3vpn-inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:30:520.277 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:30:520.285 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:05:30:520.293 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:30:520.306 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:30:520.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:05:30:520.322 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:30:520.336 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:30:520.347 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1685 2025-02-10 Mon 02:05:30:520.355 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: bgp.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:30:520.366 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Table bgp.rtarget.0 Family route-target controller/src/bgp/routing-instance/routing_instance.cc 1672 2025-02-10 Mon 02:05:30:520.377 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = route-target hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:30:520.399 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:30:520.419 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet-labeled hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:30:520.438 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:__default__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:30:520.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ ] ] Export Targets export_rt= [ [ ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:05:30:520.471 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ ] ] Export Targets export_rt= [ [ ] ] Virtual Network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2016 2025-02-10 Mon 02:05:30:520.501 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigProtocolCreateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ AdminDown 0 Local AS 64512 Router ID Address Hold Time 0 Address Families families= [ [ ] ] controller/src/bgp/bgp_config_ifmap.cc 2026 2025-02-10 Mon 02:05:30:521.003 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.0.0.38:5269 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:05:30:521.103 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: ROLE : Generator 2025-02-10 Mon 02:05:30:521.111 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: MODULE : contrail-control 2025-02-10 Mon 02:05:30:521.117 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-juju-os-472-1 2025-02-10 Mon 02:05:30:521.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: NODE TYPE : Control 2025-02-10 Mon 02:05:30:521.127 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: INSTANCE ID : 0 2025-02-10 Mon 02:05:30:521.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: HTTP SERVER PORT : 8083 2025-02-10 Mon 02:05:30:521.138 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-02-10 Mon 02:05:30:521.321 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: HTTP Introspect Init 2025-02-10 Mon 02:05:30:521.441 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8083 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:05:30:521.486 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: Sandesh Http Server Port: 8083 2025-02-10 Mon 02:05:30:521.532 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: NOT Writing http_port 8083TO : /tmp/contrail-control.0.http_port 2025-02-10 Mon 02:05:30:521.539 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2025-02-10 Mon 02:05:30:521.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: Idle 2025-02-10 Mon 02:05:30:522.003 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: SANDESH: No Client: 1739153130521883 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:05:30:523.424 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 303 2025-02-10 Mon 02:05:30:523.509 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-02-10 Mon 02:05:30:525.590 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-02-10 Mon 02:05:30:525.938 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvStart in state Idle 2025-02-10 Mon 02:05:30:526.002 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Disconnect 2025-02-10 Mon 02:05:30:526.083 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2025-02-10 Mon 02:05:30:530.737 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:30:530.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:30:530.928 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130523494 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Collector,Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:30:530.939 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:30:530.949 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:30:530.967 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130525994 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:30:530.974 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:30:530.990 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:30:532.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130526073 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 4, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:05:30:532.837 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:30:532.853 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:30:532.960 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130526131 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 4, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:05:30:532.982 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:30:532.993 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:30:533.015 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130526149 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:30:533.025 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:30:533.035 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:30:533.112 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130530875 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 4, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:05:30:533.125 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:30:541.605 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:35144::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:30:541.636 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:35144::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:30:541.675 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:35144::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:30:541.759 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:30:541.776 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:30:541.828 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: ClientInit 2025-02-10 Mon 02:05:30:541.846 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 1 2025-02-10 Mon 02:05:30:541.978 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:30:541.991 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:30:542.014 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: SANDESH: Send FAILED: 1739153130541819 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:30:542.022 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:30:542.031 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:30:542.037 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:30:542.061 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:30:542.067 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:30:542.181 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: SANDESH: Send FAILED: 1739153130541965 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 5, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 6, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-10 Mon 02:05:30:542.204 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:30:545.782 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:35144::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:30:545.853 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:35144::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:30:545.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:35144::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:30:545.915 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:30:545.925 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:30:545.973 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:05:30:545.980 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Idle 2025-02-10 Mon 02:05:30:546.144 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:30:547.085 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130545956 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:30:547.099 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:30:547.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:30:547.180 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:30:547.309 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130546134 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 1 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1689 calls = 1 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 6, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 8, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:05:30:547.329 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:30:583.054 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-02-10 Mon 02:05:30:583.226 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 307 2025-02-10 Mon 02:05:30:583.277 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 580 2025-02-10 Mon 02:05:30:583.291 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:05:30:583.174 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:30:585.660 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130583007 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:30:585.737 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:30:585.891 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:30:585.935 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153130583265 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:30:585.948 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:30:595.551 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigCassInitErrorMessage: Database initialization failed src/contrail-common/config-client-mgr/config_cassandra_client.cc 90 2025-02-10 Mon 02:05:30:595.599 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: DB uninit src/contrail-common/config-client-mgr/config_cassandra_client.cc 122 2025-02-10 Mon 02:05:31:672.897 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND Xmpp creating dynamic channel 10.0.0.38:5269::10.0.0.38:43535 controller/src/xmpp/xmpp_server.cc 586 2025-02-10 Mon 02:05:31:672.966 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-10 Mon 02:05:31:673.007 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:5269::10.0.0.38:43535 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:05:31:673.142 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.0.0.38 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-10 Mon 02:05:31:673.166 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:673.182 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153131673110 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Idle last_state = Idle last_state_at = 1739153131673081 ] ] 2025-02-10 Mon 02:05:31:673.190 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:673.198 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:673.217 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153131673122 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:673.224 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:673.271 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:673.284 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153131673243 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStart last_event_at = 1739153131673240 ] ] 2025-02-10 Mon 02:05:31:673.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:673.297 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:673.308 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153131673248 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Active last_state = Idle last_state_at = 1739153131673247 ] ] 2025-02-10 Mon 02:05:31:673.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:673.327 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:673.337 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153131673254 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvTcpPassiveOpen last_event_at = 1739153131673253 ] ] 2025-02-10 Mon 02:05:31:673.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:673.349 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:673.362 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153131673267 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active event = EvTcpPassiveOpen local_port = 5269 remote_port = 43535 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:673.368 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:688.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:688.867 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: SANDESH: Send FAILED: 1739153131688743 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] 2025-02-10 Mon 02:05:31:688.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:688.889 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:688.904 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: SANDESH: Send FAILED: 1739153131688760 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppOpen last_event_at = 1739153131688759 ] ] 2025-02-10 Mon 02:05:31:688.910 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:688.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:688.931 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: SANDESH: Send FAILED: 1739153131688796 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:688.937 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:688.945 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:688.956 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: SANDESH: Send FAILED: 1739153131688812 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = OpenConfirm last_state = Active last_state_at = 1739153131688810 ] ] 2025-02-10 Mon 02:05:31:688.962 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:693.363 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:693.405 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131693297 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStartTls last_event_at = 1739153131693292 ] ] 2025-02-10 Mon 02:05:31:693.415 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:694.281 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:31:694.308 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:694.325 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: SANDESH: Send FAILED: 1739153131694236 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Trigger Server Ssl Handshake event = EvStartTls identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:694.333 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:694.342 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:694.355 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: SANDESH: Send FAILED: 1739153131694258 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppKeepalive last_event_at = 1739153131694255 ] ] 2025-02-10 Mon 02:05:31:694.361 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:698.729 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_DEBUG]: XmppSslHandShakeMessage: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV success controller/src/xmpp/xmpp_connection.cc 402 2025-02-10 Mon 02:05:31:698.807 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:698.829 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131698785 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvTlsHandShakeSuccess last_event_at = 1739153131698781 ] ] 2025-02-10 Mon 02:05:31:698.837 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:698.845 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:698.859 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131698799 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = OpenConfirm Feature Negotiation Success event = EvTlsHandShakeSuccess ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:698.866 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:702.496 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Create cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 NoFqnSet controller/src/ifmap/ifmap_xmpp.cc 404 2025-02-10 Mon 02:05:31:702.537 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Close cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 NoFqnSet controller/src/ifmap/ifmap_xmpp.cc 410 2025-02-10 Mon 02:05:31:702.578 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Created controller/src/bgp/bgp_xmpp_channel.cc 530 2025-02-10 Mon 02:05:31:702.598 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV No BGP configuration for self - closing channel controller/src/bgp/bgp_xmpp_channel.cc 3183 2025-02-10 Mon 02:05:31:702.610 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV EndOfRib Receive timer scheduled to fire after 300 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2851 2025-02-10 Mon 02:05:31:702.622 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer scheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2875 2025-02-10 Mon 02:05:31:702.661 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State NONE, MembershipState: NONE, MembershipReqPending: 0, CloseAgain?: No: Enqueued event CLOSE, graceful 0, family unspecified controller/src/bgp/peer_close_manager.cc 144 2025-02-10 Mon 02:05:31:702.788 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:702.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153131702445 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppOpen last_event_at = 1739153131702442 ] ] 2025-02-10 Mon 02:05:31:702.821 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:702.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:702.843 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153131702476 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:702.850 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:702.857 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:702.869 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153131702483 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Established last_state = OpenConfirm last_state_at = 1739153131702480 ] ] 2025-02-10 Mon 02:05:31:702.875 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:702.888 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:702.899 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153131702637 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153131702636 ] ] 2025-02-10 Mon 02:05:31:702.905 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:702.912 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:702.921 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153131702641 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Established event = EvStop ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:702.928 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:702.939 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Destroy cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_xmpp.cc 429 2025-02-10 Mon 02:05:31:704.573 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvStop in state Idle controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:31:704.603 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:704.617 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131704534 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Idle last_state = Established last_state_at = 1739153131702690 ] ] 2025-02-10 Mon 02:05:31:704.625 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:704.633 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:704.645 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131704550 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:31:704.651 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:31:704.677 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:704.690 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131704553 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 flap_info= [ flap_count = 1 flap_time = 1739153131704552 ] ] 2025-02-10 Mon 02:05:31:704.696 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:704.703 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:704.721 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131704561 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153131704559 ] ] 2025-02-10 Mon 02:05:31:704.728 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:704.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State NONE, MembershipState: NONE, MembershipReqPending: 0, CloseAgain?: No: Move to state DELETE controller/src/bgp/peer_close_manager.cc 300 2025-02-10 Mon 02:05:31:704.760 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 0, CloseAgain?: No: Enqueued event MEMBERSHIP_REQUEST, graceful 1, family unspecified controller/src/bgp/peer_close_manager.cc 144 2025-02-10 Mon 02:05:31:704.772 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 1, CloseAgain?: No: MembershipRequestCallback controller/src/bgp/peer_close_manager.cc 531 2025-02-10 Mon 02:05:31:704.782 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 0, CloseAgain?: No: Move to state NONE controller/src/bgp/peer_close_manager.cc 542 2025-02-10 Mon 02:05:31:704.847 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapChannelUnregisterMessage: Unregistering config peer for channel cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_xmpp.cc 465 2025-02-10 Mon 02:05:31:704.873 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Deleted controller/src/bgp/bgp_xmpp_channel.cc 549 2025-02-10 Mon 02:05:31:704.929 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvStop in state Idle controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:31:704.945 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : cn-jenkins-deploy-platform-juju-os-472-1 controller/src/xmpp/xmpp_connection.cc 734 2025-02-10 Mon 02:05:31:704.961 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:704.972 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131704891 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 deleted = 1 ] 2025-02-10 Mon 02:05:31:704.979 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:31:704.986 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:705.001 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131704912 [SYS_NOTICE]: PeerStatsUve: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 deleted = 1 encoding = ] 2025-02-10 Mon 02:05:31:705.008 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: PeerStatsUve 2025-02-10 Mon 02:05:31:705.015 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:31:705.026 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153131704922 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153131704919 ] ] 2025-02-10 Mon 02:05:31:705.032 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:342.681 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND Xmpp creating dynamic channel 10.0.0.38:5269::10.0.0.38:32929 controller/src/xmpp/xmpp_server.cc 586 2025-02-10 Mon 02:05:35:342.753 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-10 Mon 02:05:35:342.792 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:5269::10.0.0.38:32929 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:05:35:342.892 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.0.0.38 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-10 Mon 02:05:35:342.911 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:342.931 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153135342861 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Idle last_state = Idle last_state_at = 1739153135342855 ] ] 2025-02-10 Mon 02:05:35:342.939 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:342.947 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:342.960 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153135342876 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:342.967 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:343.003 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:343.016 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153135342979 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStart last_event_at = 1739153135342977 ] ] 2025-02-10 Mon 02:05:35:343.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:343.038 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:343.048 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153135342984 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Active last_state = Idle last_state_at = 1739153135342982 ] ] 2025-02-10 Mon 02:05:35:343.054 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:343.061 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:343.071 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153135342988 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvTcpPassiveOpen last_event_at = 1739153135342987 ] ] 2025-02-10 Mon 02:05:35:343.077 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:343.083 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:343.096 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153135342999 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active event = EvTcpPassiveOpen local_port = 5269 remote_port = 32929 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:343.102 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:343.306 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:343.323 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135343250 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] 2025-02-10 Mon 02:05:35:343.330 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:343.338 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:343.351 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135343262 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppOpen last_event_at = 1739153135343261 ] ] 2025-02-10 Mon 02:05:35:343.358 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:343.365 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:343.376 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135343283 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:343.387 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:343.394 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:343.404 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135343294 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = OpenConfirm last_state = Active last_state_at = 1739153135343293 ] ] 2025-02-10 Mon 02:05:35:343.411 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:344.994 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:35:345.018 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:345.034 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135344953 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStartTls last_event_at = 1739153135344949 ] ] 2025-02-10 Mon 02:05:35:345.042 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:345.051 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:345.063 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135344975 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Trigger Server Ssl Handshake event = EvStartTls identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:345.070 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:345.077 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:345.088 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135344981 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppKeepalive last_event_at = 1739153135344980 ] ] 2025-02-10 Mon 02:05:35:345.104 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:350.161 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_DEBUG]: XmppSslHandShakeMessage: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV success controller/src/xmpp/xmpp_connection.cc 402 2025-02-10 Mon 02:05:35:350.250 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:350.269 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135350224 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvTlsHandShakeSuccess last_event_at = 1739153135350220 ] ] 2025-02-10 Mon 02:05:35:350.887 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:350.906 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:350.920 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135350240 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = OpenConfirm Feature Negotiation Success event = EvTlsHandShakeSuccess ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:350.927 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:351.072 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Create cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 NoFqnSet controller/src/ifmap/ifmap_xmpp.cc 404 2025-02-10 Mon 02:05:35:351.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Close cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 NoFqnSet controller/src/ifmap/ifmap_xmpp.cc 410 2025-02-10 Mon 02:05:35:351.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Created controller/src/bgp/bgp_xmpp_channel.cc 530 2025-02-10 Mon 02:05:35:351.139 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV No BGP configuration for self - closing channel controller/src/bgp/bgp_xmpp_channel.cc 3183 2025-02-10 Mon 02:05:35:351.152 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV EndOfRib Receive timer scheduled to fire after 300 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2851 2025-02-10 Mon 02:05:35:351.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer scheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2875 2025-02-10 Mon 02:05:35:351.201 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State NONE, MembershipState: NONE, MembershipReqPending: 0, CloseAgain?: No: Enqueued event CLOSE, graceful 0, family unspecified controller/src/bgp/peer_close_manager.cc 144 2025-02-10 Mon 02:05:35:351.235 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvStop in state Idle controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:35:351.252 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Destroy cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_xmpp.cc 429 2025-02-10 Mon 02:05:35:351.270 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State NONE, MembershipState: NONE, MembershipReqPending: 0, CloseAgain?: No: Move to state DELETE controller/src/bgp/peer_close_manager.cc 300 2025-02-10 Mon 02:05:35:351.282 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 0, CloseAgain?: No: Enqueued event MEMBERSHIP_REQUEST, graceful 1, family unspecified controller/src/bgp/peer_close_manager.cc 144 2025-02-10 Mon 02:05:35:351.300 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 1, CloseAgain?: No: MembershipRequestCallback controller/src/bgp/peer_close_manager.cc 531 2025-02-10 Mon 02:05:35:351.311 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 0, CloseAgain?: No: Move to state NONE controller/src/bgp/peer_close_manager.cc 542 2025-02-10 Mon 02:05:35:351.322 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.336 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351024 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppOpen last_event_at = 1739153135351022 ] ] 2025-02-10 Mon 02:05:35:351.343 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:351.350 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.362 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351055 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:351.369 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:351.376 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.387 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351060 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Established last_state = OpenConfirm last_state_at = 1739153135351058 ] ] 2025-02-10 Mon 02:05:35:351.393 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:351.400 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.410 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351178 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153135351177 ] ] 2025-02-10 Mon 02:05:35:351.416 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:351.423 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.433 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351182 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Established event = EvStop ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:351.442 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:351.449 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.459 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351217 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Idle last_state = Established last_state_at = 1739153135351215 ] ] 2025-02-10 Mon 02:05:35:351.465 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:351.472 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.481 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351220 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:35:351.487 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:35:351.494 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.505 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351222 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 flap_info= [ flap_count = 2 flap_time = 1739153135351221 ] ] 2025-02-10 Mon 02:05:35:351.511 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:351.517 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.527 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351226 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153135351225 ] ] 2025-02-10 Mon 02:05:35:351.533 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:351.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapChannelUnregisterMessage: Unregistering config peer for channel cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_xmpp.cc 465 2025-02-10 Mon 02:05:35:351.569 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Deleted controller/src/bgp/bgp_xmpp_channel.cc 549 2025-02-10 Mon 02:05:35:351.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvStop in state Idle controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:35:351.625 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.636 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351584 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 deleted = 1 ] 2025-02-10 Mon 02:05:35:351.645 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:351.653 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.673 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351599 [SYS_NOTICE]: PeerStatsUve: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 deleted = 1 encoding = ] 2025-02-10 Mon 02:05:35:351.681 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: PeerStatsUve 2025-02-10 Mon 02:05:35:351.688 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:351.698 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: SANDESH: Send FAILED: 1739153135351608 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153135351606 ] ] 2025-02-10 Mon 02:05:35:351.704 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:35:351.716 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : cn-jenkins-deploy-platform-juju-os-472-1 controller/src/xmpp/xmpp_connection.cc 734 2025-02-10 Mon 02:05:35:546.093 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:35:546.384 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:35:546.547 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:35:546.580 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135546180 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:35:546.589 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:35:546.598 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:35:546.904 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: SANDESH: Send FAILED: 1739153135546523 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 1 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1689 calls = 1 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 58, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:05:35:546.936 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:35:554.408 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:35314::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:35:554.644 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:35314::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:35:554.656 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:35314::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:35:555.256 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:35:555.286 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:35:555.462 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: ClientInit 2025-02-10 Mon 02:05:35:555.486 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 2 2025-02-10 Mon 02:05:35:555.620 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:35:555.630 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:35:555.655 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: SANDESH: Send FAILED: 1739153135555439 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:35:555.672 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:35:555.680 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:35:555.697 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:35:555.721 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:35:555.728 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:35:555.999 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: SANDESH: Send FAILED: 1739153135555602 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 2 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1689 calls = 1 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 59, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 68, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-02-10 Mon 02:05:35:556.020 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:35:557.707 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:35314::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:35:557.771 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:35314::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:35:557.780 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:35314::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:35:557.817 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:35:557.828 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:35:557.876 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:05:35:557.884 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Idle 2025-02-10 Mon 02:05:35:558.016 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:558.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: SANDESH: Send FAILED: 1739153135557857 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:35:558.063 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:35:558.073 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:35:558.138 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:35:558.424 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: SANDESH: Send FAILED: 1739153135557995 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 2 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 3378 calls = 2 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 60, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 70, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:05:35:558.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:35:595.729 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:05:35:598.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigCassInitErrorMessage: Database initialization failed src/contrail-common/config-client-mgr/config_cassandra_client.cc 90 2025-02-10 Mon 02:05:35:598.083 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: DB uninit src/contrail-common/config-client-mgr/config_cassandra_client.cc 122 2025-02-10 Mon 02:05:40:558.014 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:40:558.266 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:40:558.413 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:40:558.443 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: SANDESH: Send FAILED: 1739153140558086 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:40:558.459 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:40:558.468 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:40:558.761 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: SANDESH: Send FAILED: 1739153140558392 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 2 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 3378 calls = 2 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 63, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 72, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:05:40:561.236 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:40:566.237 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:42450::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:40:566.268 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:42450::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:40:566.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:42450::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:40:567.096 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:40:567.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:40:567.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: ClientInit 2025-02-10 Mon 02:05:40:568.789 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 3 2025-02-10 Mon 02:05:40:568.972 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:40:568.992 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:40:569.017 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: SANDESH: Send FAILED: 1739153140567163 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:40:569.026 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:40:569.041 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:40:569.050 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:40:569.083 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:40:569.091 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:40:569.420 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: SANDESH: Send FAILED: 1739153140568953 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 3 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 3378 calls = 2 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 64, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 74, _iter59->first = sent _iter59->second = 2, ] ] ] 2025-02-10 Mon 02:05:40:569.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:40:571.008 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:42450::10.0.0.38:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:40:571.069 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:42450::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-10 Mon 02:05:40:571.090 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:42450::10.0.0.38:8086(-1):EvTcpClose 2025-02-10 Mon 02:05:40:571.137 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2025-02-10 Mon 02:05:40:571.153 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: ClientInit : EvTcpClose 2025-02-10 Mon 02:05:40:571.200 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Return to idle with 5000 2025-02-10 Mon 02:05:40:571.209 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Idle 2025-02-10 Mon 02:05:40:571.305 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:40:571.330 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: SANDESH: Send FAILED: 1739153140571186 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:40:571.338 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:40:571.347 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-10 Mon 02:05:40:571.397 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:40:571.692 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: SANDESH: Send FAILED: 1739153140571287 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Idle successful_connections = 3 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 5067 calls = 3 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 65, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 76, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:05:40:571.715 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:40:599.017 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:05:40:602.424 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigCassInitErrorMessage: Database initialization failed src/contrail-common/config-client-mgr/config_cassandra_client.cc 90 2025-02-10 Mon 02:05:40:602.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: DB uninit src/contrail-common/config-client-mgr/config_cassandra_client.cc 122 2025-02-10 Mon 02:05:43:565.862 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND Xmpp creating dynamic channel 10.0.0.38:5269::10.0.0.38:45167 controller/src/xmpp/xmpp_server.cc 586 2025-02-10 Mon 02:05:43:565.953 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-10 Mon 02:05:43:565.999 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:5269::10.0.0.38:45167 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:05:43:566.082 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:566.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.0.0.38 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-10 Mon 02:05:43:566.121 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143566032 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Idle last_state = Idle last_state_at = 1739153143566022 ] ] 2025-02-10 Mon 02:05:43:568.012 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:568.036 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.063 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143566071 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:568.072 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:568.082 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.097 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143566163 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStart last_event_at = 1739153143566160 ] ] 2025-02-10 Mon 02:05:43:568.104 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:568.112 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.132 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143566172 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Active last_state = Idle last_state_at = 1739153143566171 ] ] 2025-02-10 Mon 02:05:43:568.139 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:568.147 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.158 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143566178 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvTcpPassiveOpen last_event_at = 1739153143566177 ] ] 2025-02-10 Mon 02:05:43:568.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:568.171 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.184 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143566192 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active event = EvTcpPassiveOpen local_port = 5269 remote_port = 45167 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:568.191 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:568.198 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.208 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143567084 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] 2025-02-10 Mon 02:05:43:568.214 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:568.221 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.232 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143567099 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppOpen last_event_at = 1739153143567098 ] ] 2025-02-10 Mon 02:05:43:568.238 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:568.245 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.255 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143567129 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:568.262 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:568.268 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:568.280 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143567141 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = OpenConfirm last_state = Active last_state_at = 1739153143567139 ] ] 2025-02-10 Mon 02:05:43:568.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:569.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:569.490 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: SANDESH: Send FAILED: 1739153143569435 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStartTls last_event_at = 1739153143569431 ] ] 2025-02-10 Mon 02:05:43:569.504 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:569.491 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:43:569.516 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:569.761 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: SANDESH: Send FAILED: 1739153143569465 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Trigger Server Ssl Handshake event = EvStartTls identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:569.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:569.776 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:569.788 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: SANDESH: Send FAILED: 1739153143569475 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppKeepalive last_event_at = 1739153143569472 ] ] 2025-02-10 Mon 02:05:43:569.794 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:573.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_DEBUG]: XmppSslHandShakeMessage: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV success controller/src/xmpp/xmpp_connection.cc 402 2025-02-10 Mon 02:05:43:573.692 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:573.734 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: SANDESH: Send FAILED: 1739153143573643 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvTlsHandShakeSuccess last_event_at = 1739153143573639 ] ] 2025-02-10 Mon 02:05:43:573.744 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:573.754 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:573.767 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: SANDESH: Send FAILED: 1739153143573678 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = OpenConfirm Feature Negotiation Success event = EvTlsHandShakeSuccess ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:573.782 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:575.129 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:575.162 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Create cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 NoFqnSet controller/src/ifmap/ifmap_xmpp.cc 404 2025-02-10 Mon 02:05:43:575.178 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153143575103 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvXmppOpen last_event_at = 1739153143575100 ] ] 2025-02-10 Mon 02:05:43:575.184 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Close cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 NoFqnSet controller/src/ifmap/ifmap_xmpp.cc 410 2025-02-10 Mon 02:05:43:575.188 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:575.209 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:575.223 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153143575142 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:575.227 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Created controller/src/bgp/bgp_xmpp_channel.cc 530 2025-02-10 Mon 02:05:43:575.230 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:575.259 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:575.271 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: SANDESH: Send FAILED: 1739153143575148 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Established last_state = OpenConfirm last_state_at = 1739153143575146 ] ] 2025-02-10 Mon 02:05:43:575.277 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:575.249 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV No BGP configuration for self - closing channel controller/src/bgp/bgp_xmpp_channel.cc 3183 2025-02-10 Mon 02:05:43:575.463 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV EndOfRib Receive timer scheduled to fire after 300 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2851 2025-02-10 Mon 02:05:43:575.475 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer scheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2875 2025-02-10 Mon 02:05:43:575.534 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State NONE, MembershipState: NONE, MembershipReqPending: 0, CloseAgain?: No: Enqueued event CLOSE, graceful 0, family unspecified controller/src/bgp/peer_close_manager.cc 144 2025-02-10 Mon 02:05:43:575.537 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Destroy cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_xmpp.cc 429 2025-02-10 Mon 02:05:43:575.573 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvStop in state Idle controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:43:575.601 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State NONE, MembershipState: NONE, MembershipReqPending: 0, CloseAgain?: No: Move to state DELETE controller/src/bgp/peer_close_manager.cc 300 2025-02-10 Mon 02:05:43:575.546 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:575.678 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153143575502 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153143575500 ] ] 2025-02-10 Mon 02:05:43:575.693 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:575.707 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:575.725 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153143575517 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Established event = EvStop ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:575.736 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:575.747 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:575.766 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153143575555 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 state_info= [ state = Idle last_state = Established last_state_at = 1739153143575553 ] ] 2025-02-10 Mon 02:05:43:575.776 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:575.787 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:575.804 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153143575558 [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:05:43:575.813 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XmppConnectionLog 2025-02-10 Mon 02:05:43:575.832 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:575.851 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153143575561 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 flap_info= [ flap_count = 3 flap_time = 1739153143575560 ] ] 2025-02-10 Mon 02:05:43:575.861 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:575.873 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:575.890 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SANDESH: Send FAILED: 1739153143575566 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153143575565 ] ] 2025-02-10 Mon 02:05:43:575.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:575.632 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 0, CloseAgain?: No: Enqueued event MEMBERSHIP_REQUEST, graceful 1, family unspecified controller/src/bgp/peer_close_manager.cc 144 2025-02-10 Mon 02:05:43:576.231 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 1, CloseAgain?: No: MembershipRequestCallback controller/src/bgp/peer_close_manager.cc 531 2025-02-10 Mon 02:05:43:576.250 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State DELETE, MembershipState: IN_USE, MembershipReqPending: 0, CloseAgain?: No: Move to state NONE controller/src/bgp/peer_close_manager.cc 542 2025-02-10 Mon 02:05:43:576.292 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapChannelUnregisterMessage: Unregistering config peer for channel cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_xmpp.cc 465 2025-02-10 Mon 02:05:43:576.373 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Deleted controller/src/bgp/bgp_xmpp_channel.cc 549 2025-02-10 Mon 02:05:43:576.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:576.444 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143576397 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 deleted = 1 ] 2025-02-10 Mon 02:05:43:576.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:576.465 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:576.482 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143576414 [SYS_NOTICE]: PeerStatsUve: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 deleted = 1 encoding = ] 2025-02-10 Mon 02:05:43:576.492 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: PeerStatsUve 2025-02-10 Mon 02:05:43:576.533 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvStop in state Idle controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:05:43:576.551 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-02-10 Mon 02:05:43:576.569 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: SANDESH: Send FAILED: 1739153143576523 [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153143576519 ] ] 2025-02-10 Mon 02:05:43:576.579 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: XMPPPeerInfo 2025-02-10 Mon 02:05:43:576.594 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : cn-jenkins-deploy-platform-juju-os-472-1 controller/src/xmpp/xmpp_connection.cc 734 2025-02-10 Mon 02:05:44:480.187 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:51088 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:05:44:525.524 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:51088 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:45:572.017 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-10 Mon 02:05:45:572.289 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2025-02-10 Mon 02:05:45:572.582 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:45:572.616 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: SANDESH: Send FAILED: 1739153145572091 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:45:572.626 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-10 Mon 02:05:45:572.637 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-02-10 Mon 02:05:45:572.984 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: SANDESH: Send FAILED: 1739153145572559 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = Connect successful_connections = 3 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 5067 calls = 3 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 54 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 93, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 105, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:05:45:573.018 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-10 Mon 02:05:45:580.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:42602::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-10 Mon 02:05:45:581.280 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:42602::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2025-02-10 Mon 02:05:45:581.298 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: 10.0.0.38:42602::10.0.0.38:8086(-1):EvTcpConnected 2025-02-10 Mon 02:05:45:582.392 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-02-10 Mon 02:05:45:582.415 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-10 Mon 02:05:45:582.460 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: ClientInit 2025-02-10 Mon 02:05:45:582.477 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-472-1:contrail-control:0:Control count 4 2025-02-10 Mon 02:05:45:582.585 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:45:582.595 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-10 Mon 02:05:45:582.620 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: SANDESH: Send FAILED: 1739153145582451 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] ] 2025-02-10 Mon 02:05:45:582.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-02-10 Mon 02:05:45:582.648 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:45:582.655 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-10 Mon 02:05:45:582.684 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-02-10 Mon 02:05:45:582.691 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-10 Mon 02:05:45:582.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: SANDESH: Send FAILED: 1739153145582570 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 4 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 5067 calls = 3 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 54 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 94, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 107, _iter59->first = sent _iter59->second = 3, ] ] ] 2025-02-10 Mon 02:05:45:582.984 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-10 Mon 02:05:45:594.166 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: OnMessage control in state: ClientInit 2025-02-10 Mon 02:05:45:594.221 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-02-10 Mon 02:05:45:594.232 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: ClientInit : EvSandeshMessageRecv 2025-02-10 Mon 02:05:45:594.260 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Received Ctrl Message with size 0 2025-02-10 Mon 02:05:45:594.280 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncAllMaps for BgpPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:45:594.289 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncAllMaps for BgpRouterState:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:45:594.721 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-juju-os-472-1:Control:contrail-control:0 client_info= [ status = ClientInit successful_connections = 4 pid = 1 http_port = 8083 start_time = 1739153130521786 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 5067 calls = 3 average_bytes = 1689 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigCassInitErrorMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapChannelUnregisterMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapXmppChannelEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = PeerStatsUve [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XMPPPeerInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 54 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppPeerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppSslHandShakeMessage [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppUnconsumedEvent [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 94, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 107, _iter59->first = sent _iter59->second = 3, ] ] proxy seq 14 2025-02-10 Mon 02:05:45:594.777 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:45:594.804 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncUVE Syncing ObjectBgpRouter val name = cn-jenkins-deploy-platform-juju-os-472-1 process_status= [ [ [ module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.38:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.38:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ], ] ] proxy seq 15 2025-02-10 Mon 02:05:45:594.817 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:45:594.825 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:45:594.843 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:45:594.851 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncAllMaps for RoutingInstanceStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-02-10 Mon 02:05:45:594.869 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncUVE Syncing ObjectXmppPeerInfo val name = cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 event_info= [ last_event = xmsm::EvStop last_event_at = 1739153143576519 ] proxy seq 54 2025-02-10 Mon 02:05:45:594.879 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 1 2025-02-10 Mon 02:05:45:594.922 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: Established 2025-02-10 Mon 02:05:45:603.025 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-10 Mon 02:05:46:337.210 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-02-10 Mon 02:05:46:340.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 104 2025-02-10 Mon 02:05:46:340.111 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 110 2025-02-10 Mon 02:05:46:340.194 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:340.204 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 393 2025-02-10 Mon 02:05:46:343.986 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:361.745 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:365.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:370.615 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:372.490 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:374.191 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:376.374 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:378.275 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:380.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:382.473 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:384.400 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:387.394 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:389.851 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:391.229 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:393.093 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:394.565 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:396.536 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:398.488 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:400.389 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:402.110 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:403.966 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:405.793 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:407.283 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:409.145 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:410.766 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:412.843 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:419.871 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:421.571 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:424.961 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:429.151 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:431.970 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:434.952 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:437.253 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:439.360 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:441.187 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:442.831 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:445.553 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:447.298 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:449.556 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:452.079 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:455.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:456.783 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:458.595 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:460.440 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:462.352 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:464.264 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:466.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:467.359 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:468.914 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:471.032 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:472.944 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:474.568 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:475.952 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:477.370 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:480.779 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:482.406 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:484.458 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:486.328 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:492.320 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:495.349 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:498.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:500.622 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:502.627 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:504.980 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:506.393 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:508.491 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:509.915 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:512.539 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:514.014 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:515.725 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:517.482 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:518.689 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:520.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:521.388 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:522.885 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:524.764 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:528.627 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:531.924 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:534.222 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:536.005 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:540.964 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:543.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:548.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:550.846 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:554.196 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:556.161 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:558.453 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:560.815 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:565.729 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:570.398 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:573.289 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:577.258 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:579.390 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:581.411 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:584.533 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:585.821 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:587.057 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:588.327 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:589.953 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:591.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:595.262 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:606.006 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:612.844 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:614.256 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:623.555 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:629.548 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:635.922 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:638.539 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:641.325 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:643.098 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:644.476 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:646.192 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:648.293 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:653.701 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:657.615 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:659.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:662.805 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:664.753 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:671.386 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:05:46:671.524 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:05:46:671.592 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:05:46:671.633 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:05:46:671.702 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:05:46:671.949 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:05:46:671.985 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 554 2025-02-10 Mon 02:05:46:672.001 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 197 2025-02-10 Mon 02:05:46:672.101 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094157592320, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-02-10 Mon 02:05:46:671.386 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-10 Mon 02:05:46:691.434 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:691.696 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.749 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.767 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:691.787 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-target:target:64512:8000003 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.798 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-target:attr(default-domain:default-project:ip-fabric:ip-fabric,target:64512:8000003) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.810 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:691.825 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:691.839 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-target:target:64512:8000000 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.860 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.891 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.902 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:691.915 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.938 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.950 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:691.963 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:691.981 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:692.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:692.127 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:05:46:692.158 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:692.175 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:692.227 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:05:46:692.326 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = add_import_rt= [ [ (*_iter24) = target:64512:7999999, (*_iter24) = target:64512:8000003, ] ] add_export_rt= [ [ (*_iter26) = target:64512:8000003, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:05:46:692.612 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:692.630 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:692.650 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:692.957 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:692.981 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:692.822 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:693.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:693.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:693.134 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.148 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:693.185 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:693.197 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.208 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:693.219 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:693.229 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.238 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:693.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:693.256 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.269 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:693.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:693.325 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.335 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:693.344 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:693.354 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.363 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:693.373 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:693.382 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.392 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:693.424 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:693.438 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.448 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:693.461 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:693.470 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.478 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:693.487 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:693.496 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.506 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:693.531 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Table default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:693.541 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.550 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:693.559 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:7999999 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:693.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.576 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000003 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:693.586 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:693.595 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 target:64512:8000003 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:693.605 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:693.646 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:05:46:693.695 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:693.748 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:693.791 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:693.832 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:711.556 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:712.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:712.268 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:712.289 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:dci-network:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:712.311 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:712.327 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:712.355 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-target:target:64512:8000001 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:712.366 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-target:attr(default-domain:default-project:dci-network:dci-network,target:64512:8000001) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:712.379 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:712.394 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:712.412 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:712.432 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:712.448 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:712.465 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:712.613 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:05:46:712.627 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:712.711 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:712.731 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:712.793 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:712.814 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:05:46:712.836 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:712.858 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:712.877 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:712.898 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:712.912 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:712.915 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = add_import_rt= [ [ (*_iter24) = target:64512:7999999, (*_iter24) = target:64512:8000001, ] ] add_export_rt= [ [ (*_iter26) = target:64512:8000001, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:05:46:712.926 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:712.945 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:712.956 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:712.881 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:712.987 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:713.010 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:713.046 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:713.051 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:713.061 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:713.078 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:713.099 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:713.116 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:713.131 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:713.166 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:713.181 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:713.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:713.217 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:712.969 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.inet.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:713.401 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:713.421 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:713.435 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet6.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:713.451 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:713.668 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:714.727 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:714.773 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet6.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:714.788 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:714.840 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:714.853 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:714.865 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:714.875 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:714.884 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:714.885 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:714.910 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:715.054 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.126 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating bgp-router:default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.168 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:ip-fabric:__default__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.186 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-bgp-router controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.206 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.232 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.260 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.296 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.310 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.332 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.351 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.371 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.385 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.451 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:dci-network:__default__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.472 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.492 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-target:attr(default-domain:default-project:dci-network:__default__,target:64512:8000000) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.512 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.528 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.546 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.582 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.601 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:715.614 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.632 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:715.649 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:714.960 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:715.740 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:715.785 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:715.799 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:715.799 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:715.814 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.evpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:715.955 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:715.965 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:715.976 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.evpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:715.988 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:716.034 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Table default-domain:default-project:dci-network:dci-network.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:716.046 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094174385920, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:716.047 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.079 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.mvpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.090 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000001 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:716.100 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:716.111 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.mvpn.0 target:64512:8000001 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:dci-network.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:716.158 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:05:46:716.211 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, ] ] Export Targets export_rt= [ [ ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:716.225 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, ] ] Export Targets export_rt= [ [ ] ] Virtual Network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:716.242 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:716.256 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:716.268 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: Starting Bgp Server at 10.0.0.38:179 2025-02-10 Mon 02:05:46:716.320 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.0.0.38:179 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-10 Mon 02:05:46:716.348 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_DEBUG]: BgpConfigLog: Updated Router ID from 0.0.0.0 to 10.0.0.38 controller/src/bgp/bgp_server.cc 261 2025-02-10 Mon 02:05:46:716.360 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_DEBUG]: BgpConfigLog: Updated Autonomous System from 0 to 64512 controller/src/bgp/bgp_server.cc 285 2025-02-10 Mon 02:05:46:716.369 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_DEBUG]: BgpConfigLog: Updated Local Autonomous System from 0 to 64512 controller/src/bgp/bgp_server.cc 301 2025-02-10 Mon 02:05:46:716.443 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigProtocolUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ AdminDown 0 Local AS 64512 Router ID 10.0.0.38 Address 10.0.0.38 Hold Time 0 Address Families families= [ [ route-target, inet-vpn, e-vpn, erm-vpn, inet6-vpn, ] ] controller/src/bgp/bgp_config_ifmap.cc 2357 2025-02-10 Mon 02:05:46:716.478 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:716.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:716.525 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:05:46:716.546 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:716.557 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:716.575 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:716.590 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:716.621 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.ermvpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.624 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:05:46:716.764 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:3, (*_iter24) = target:64512:7999999, (*_iter24) = target:64512:8000000, ] ] add_export_rt= [ [ (*_iter26) = target:64512:8000000, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:05:46:716.770 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:716.808 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.822 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.837 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:716.847 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:716.861 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:716.862 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.890 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:716.901 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:716.911 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.923 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.inet.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:716.952 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:716.975 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.986 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet6.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.995 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:717.004 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:717.042 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet6.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:717.057 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:717.068 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:717.079 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.inet6.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:716.648 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:717.105 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:717.119 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.mvpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:717.130 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:717.140 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:717.149 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.evpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:717.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:717.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:717.183 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:717.192 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:717.201 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:716.957 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:717.093 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:717.257 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:717.270 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:717.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:717.281 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.ermvpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:717.333 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:717.352 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:717.369 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.ermvpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:717.375 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:dci-network.inet6.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:717.389 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:2 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:717.380 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:717.423 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:717.436 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.ermvpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:717.448 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:717.399 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:2 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:717.489 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:717.516 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network route_distinguisher = 10.0.0.38:2 operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:2, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:05:46:717.568 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:717.494 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:718.097 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.109 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.evpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.119 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:718.129 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:718.139 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.evpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.149 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:718.159 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:718.168 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.evpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.179 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:718.217 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Table default-domain:default-project:dci-network:__default__.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:718.228 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.237 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.mvpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.248 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000000 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:718.257 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:718.273 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.mvpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.283 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:3 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:718.293 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:3 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:718.303 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:dci-network:__default__.mvpn.0 target:64512:8000000 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:dci-network:__default__.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:718.340 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:05:46:718.360 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.374 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:718.384 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:718.396 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.405 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:718.415 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:718.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.evpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.435 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:718.447 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:718.457 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.466 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:718.475 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:718.485 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:ip-fabric:ip-fabric.inet6.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:718.494 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:1 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:718.503 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:1 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:718.524 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:718.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:718.639 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric route_distinguisher = 10.0.0.38:1 operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:1, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390 2025-02-10 Mon 02:05:46:733.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:734.042 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:734.094 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:734.141 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:734.268 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:734.859 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:734.887 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:734.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:734.927 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:735.993 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:736.041 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] Virtual Network default-domain:default-project:dci-network VN Index 0 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:736.096 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:736.102 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.135 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-target:target:64512:8000002 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.152 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.173 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.309 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.371 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.388 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.405 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.428 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.467 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.495 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.522 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.536 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.553 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:default-virtual-network:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.587 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.605 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-target:attr(default-domain:default-project:default-virtual-network:default-virtual-network,target:64512:8000002) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:736.618 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.632 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-target controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:736.154 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] VN Index 0 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:736.854 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, target:64512:8000002, ] ] Export Targets export_rt= [ [ target:64512:8000002, ] ] Virtual Network default-domain:default-project:default-virtual-network VN Index 1 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:05:46:736.876 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:736.895 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] Virtual Network default-domain:default-project:dci-network VN Index 4 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:736.918 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, target:64512:8000002, ] ] Export Targets export_rt= [ [ target:64512:8000002, ] ] Virtual Network default-domain:default-project:default-virtual-network VN Index 1 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:736.934 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, target:64512:8000002, ] ] Export Targets export_rt= [ [ target:64512:8000002, ] ] Virtual Network default-domain:default-project:default-virtual-network VN Index 1 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:736.968 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:__default__ Import Targets import_rt= [ [ target:10.0.0.38:3, target:64512:7999999, target:64512:8000000, ] ] Export Targets export_rt= [ [ target:64512:8000000, ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:736.990 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:dci-network Routing Instance default-domain:default-project:dci-network:dci-network Import Targets import_rt= [ [ target:10.0.0.38:2, target:64512:7999999, target:64512:8000001, ] ] Export Targets export_rt= [ [ target:64512:8000001, ] ] VN Index 4 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:737.007 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, target:64512:8000002, ] ] Export Targets export_rt= [ [ target:64512:8000002, ] ] VN Index 1 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:05:46:737.058 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:737.073 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:737.087 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:737.107 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:737.117 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:737.128 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:737.139 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:737.149 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:737.158 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:737.171 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:737.199 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:737.209 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:737.220 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:737.229 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:737.238 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:737.249 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:737.263 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:737.330 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:4, (*_iter24) = target:64512:7999999, (*_iter24) = target:64512:8000002, ] ] add_export_rt= [ [ (*_iter26) = target:64512:8000002, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:05:46:737.458 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:737.515 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:737.889 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:737.912 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:737.924 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.inet6.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:737.966 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:737.978 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:737.990 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.001 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:738.020 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:738.030 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.041 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:738.051 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:738.061 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.071 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.ermvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:738.102 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:738.114 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.124 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.134 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:738.144 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:738.154 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.164 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:738.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:738.187 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.197 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.evpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:738.219 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Table default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:738.230 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.240 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.250 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000002 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:738.260 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:738.270 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.280 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:4 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:738.290 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:4 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:738.299 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 target:64512:8000002 0 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:738.309 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RprRegTableLog: default-domain:default-project:default-virtual-network:default-virtual-network.mvpn.0 controller/src/bgp/routing-instance/routepath_replicator.cc 206 2025-02-10 Mon 02:05:46:738.344 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:default-virtual-network Routing Instance default-domain:default-project:default-virtual-network:default-virtual-network Import Targets import_rt= [ [ target:10.0.0.38:4, target:64512:7999999, target:64512:8000002, ] ] Export Targets export_rt= [ [ target:64512:8000002, ] ] VN Index 1 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:05:46:738.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:738.851 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:738.900 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:741.864 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:742.417 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:742.480 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:742.501 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:742.514 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:742.583 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:742.619 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:742.640 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:742.656 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:742.693 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:742.707 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:742.723 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:742.753 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:742.771 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:742.787 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:742.813 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:755.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:755.739 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:755.777 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:755.795 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:755.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:755.848 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:755.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:755.882 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:755.912 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-bgp-router controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:755.938 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:755.951 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:755.967 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:755.988 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:756.002 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:756.019 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:756.033 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:756.049 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:756.061 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:756.075 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:756.088 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:756.104 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:756.223 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:756.262 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:756.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:756.316 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:05:46:756.528 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:46:757.181 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:757.213 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:757.228 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:757.246 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:757.261 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating routing-instance:default-domain:default-project:__link_local__:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:757.283 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:757.299 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:757.317 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:757.331 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:757.346 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:757.363 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:757.383 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:757.397 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:757.416 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:757.432 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:757.463 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:757.476 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:46:757.492 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:05:46:757.570 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceCreateLog: Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:10.0.0.38:5, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:__link_local__ VN Index 3 controller/src/bgp/bgp_config_ifmap.cc 2179 2025-02-10 Mon 02:05:46:757.589 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:10.0.0.38:5, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:__link_local__ VN Index 3 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:05:46:757.611 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:10.0.0.38:5, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 3 controller/src/bgp/routing-instance/routing_instance.cc 1231 2025-02-10 Mon 02:05:46:757.658 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.inet.0 Family inet controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:757.682 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.inet.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:757.697 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.inet.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:757.717 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:757.727 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:757.757 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.inet6.0 Family inet6 controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:757.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.inet6.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:757.779 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.inet6.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:757.789 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:757.799 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.l3vpn-inet6.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:757.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.ermvpn.0 Family erm-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:757.841 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.ermvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:757.908 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.ermvpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:757.924 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:757.954 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.ermvpn.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:758.059 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.evpn.0 Family e-vpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:758.080 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.evpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:758.100 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.evpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:758.112 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:758.122 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.evpn.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:758.147 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceTableCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Table default-domain:default-project:__link_local__:__link_local__.mvpn.0 Family inet-mvpn controller/src/bgp/routing-instance/routing_instance.cc 1701 2025-02-10 Mon 02:05:46:758.157 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.mvpn.0 target:64512:7999999 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:758.168 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: default-domain:default-project:__link_local__:__link_local__.mvpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 302 2025-02-10 Mon 02:05:46:758.179 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:5 1 controller/src/bgp/routing-instance/routepath_replicator.cc 273 2025-02-10 Mon 02:05:46:758.189 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RprTableJoinLog: bgp.mvpn.0 target:10.0.0.38:5 0 controller/src/bgp/routing-instance/routepath_replicator.cc 275 2025-02-10 Mon 02:05:46:758.217 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceCreateLog: VirtualNetwork default-domain:default-project:__link_local__ Routing Instance default-domain:default-project:__link_local__:__link_local__ Import Targets import_rt= [ [ target:10.0.0.38:5, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 3 controller/src/bgp/routing-instance/routing_instance.cc 591 2025-02-10 Mon 02:05:46:758.255 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = add_import_rt= [ [ (*_iter24) = target:10.0.0.38:5, (*_iter24) = target:64512:7999999, ] ] hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238 2025-02-10 Mon 02:05:46:758.321 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:758.372 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:758.416 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:758.459 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:46:758.500 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718 2025-02-10 Mon 02:05:52:196.294 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:37684 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:05:52:246.007 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:37684 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:05:56:795.048 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:56:977.519 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:56:989.941 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:59:203.817 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:59:269.895 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:05:59:270.135 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:05:59:270.233 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:06:00:571.893 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND Xmpp creating dynamic channel 10.0.0.38:5269::10.0.0.38:44363 controller/src/xmpp/xmpp_server.cc 586 2025-02-10 Mon 02:06:00:571.953 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-juju-os-472-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-10 Mon 02:06:00:572.744 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:5269::10.0.0.38:44363 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:06:00:572.845 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.0.0.38 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-10 Mon 02:06:00:573.814 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:574.070 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active event = EvTcpPassiveOpen local_port = 5269 remote_port = 44363 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:574.171 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = Active next_state = Open Confirm event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:574.322 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: XMPP [SYS_INFO]: XmppUnconsumedEvent: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV Mode Server: Unconsumed Event xmsm::EvXmppKeepalive in state OpenConfirm controller/src/xmpp/xmpp_state_machine.cc 1649 2025-02-10 Mon 02:06:00:575.230 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Trigger Server Ssl Handshake event = EvStartTls identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:580.695 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: XMPP [SYS_DEBUG]: XmppSslHandShakeMessage: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV success controller/src/xmpp/xmpp_connection.cc 402 2025-02-10 Mon 02:06:00:581.675 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = OpenConfirm Feature Negotiation Success event = EvTlsHandShakeSuccess ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:582.434 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.38 state = OpenConfirm next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-juju-os-472-1 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-10 Mon 02:06:00:582.443 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppChannelEvent: Create cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 NoFqnSet controller/src/ifmap/ifmap_xmpp.cc 404 2025-02-10 Mon 02:06:00:582.508 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Created controller/src/bgp/bgp_xmpp_channel.cc 530 2025-02-10 Mon 02:06:00:582.529 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV EndOfRib Receive timer scheduled to fire after 300 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2851 2025-02-10 Mon 02:06:00:582.550 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer scheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2875 2025-02-10 Mon 02:06:00:631.252 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: IFMap [SYS_DEBUG]: IFMapServerClientRegUnreg: Register request for client default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 index 0 controller/src/ifmap/ifmap_server.cc 237 2025-02-10 Mon 02:06:00:631.348 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: IFMapXMPP [SYS_DEBUG]: IFMapXmppVrSubUnsub: VrSubscribe cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_xmpp.cc 205 2025-02-10 Mon 02:06:00:728.233 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:06:00:729.213 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:06:00:729.261 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:06:01:582.717 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:01:835.250 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:06:01:835.491 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigProtocolUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ AdminDown 0 Local AS 64512 Router ID 10.0.0.38 Address 10.0.0.38 Hold Time 0 Address Families families= [ [ route-target, inet-vpn, e-vpn, erm-vpn, inet6-vpn, ] ] controller/src/bgp/bgp_config_ifmap.cc 2357 2025-02-10 Mon 02:06:02:583.564 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:03:156.852 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:06:03:157.035 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:06:03:157.076 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:06:03:583.756 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:03:601.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:06:03:601.369 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:06:03:601.408 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:06:04:584.379 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:05:189.566 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:06:05:299.249 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:06:05:299.930 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:06:05:299.978 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:06:05:300.025 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: LinkOper: LinkAdd virtual-router:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 - global-system-config:default-global-system-config , lhs: 1 , rhs: controller/src/ifmap/ifmap_graph_walker.cc 112 2025-02-10 Mon 02:06:05:300.053 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: global-system-config:default-global-system-config , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:05:300.089 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: bgp-router:default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-472-1 , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:05:300.107 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: global-qos-config:default-global-system-config:default-global-qos-config , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:05:300.123 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: global-vrouter-config:default-global-system-config:default-global-vrouter-config , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:05:300.143 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: routing-instance:default-domain:default-project:ip-fabric:__default__ , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:05:300.161 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: application-policy-set:default-policy-management:default-application-policy-set , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:05:300.176 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: policy-management:default-policy-management , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:05:300.253 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of virtual-router:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:300.296 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of global-system-config:default-global-system-config to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.222 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.249 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of bgp-router:default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-472-1 to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.271 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.288 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of global-qos-config:default-global-system-config:default-global-qos-config to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.305 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.315 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of global-vrouter-config:default-global-system-config:default-global-vrouter-config to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.337 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.346 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of routing-instance:default-domain:default-project:ip-fabric:__default__ to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.357 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.433 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of application-policy-set:default-policy-management:default-application-policy-set to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.450 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.460 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of policy-management:default-policy-management to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.478 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:05:304.597 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigProtocolUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ AdminDown 0 Local AS 64512 Router ID 10.0.0.38 Address 10.0.0.38 Hold Time 0 Address Families families= [ [ route-target, inet-vpn, e-vpn, erm-vpn, inet6-vpn, ] ] controller/src/bgp/bgp_config_ifmap.cc 2357 2025-02-10 Mon 02:06:05:304.637 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:06:05:304.653 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094261221120, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:06:05:346.823 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table inet.0 with id 0 controller/src/bgp/bgp_xmpp_channel.cc 2192 2025-02-10 Mon 02:06:05:346.880 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table inet.3 with id 0 controller/src/bgp/bgp_xmpp_channel.cc 2192 2025-02-10 Mon 02:06:05:346.893 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table inet6.0 with id 0 controller/src/bgp/bgp_xmpp_channel.cc 2192 2025-02-10 Mon 02:06:05:346.970 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table inet.0 in instance default-domain:default-project:ip-fabric:__default__ : Register table requested for action 1 controller/src/bgp/bgp_membership.cc 637 2025-02-10 Mon 02:06:05:347.000 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table inet.3 in instance default-domain:default-project:ip-fabric:__default__ : Register table requested for action 1 controller/src/bgp/bgp_membership.cc 637 2025-02-10 Mon 02:06:05:347.036 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table inet6.0 in instance default-domain:default-project:ip-fabric:__default__ : Register table requested for action 1 controller/src/bgp/bgp_membership.cc 637 2025-02-10 Mon 02:06:05:347.065 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table inet.0 in instance default-domain:default-project:ip-fabric:__default__ : Register table completed for action 1 controller/src/bgp/bgp_membership.cc 652 2025-02-10 Mon 02:06:05:347.091 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table inet.0 completed controller/src/bgp/bgp_xmpp_channel.cc 2270 2025-02-10 Mon 02:06:05:347.117 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table inet.3 in instance default-domain:default-project:ip-fabric:__default__ : Register table completed for action 1 controller/src/bgp/bgp_membership.cc 652 2025-02-10 Mon 02:06:05:347.128 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table inet.3 completed controller/src/bgp/bgp_xmpp_channel.cc 2270 2025-02-10 Mon 02:06:05:347.145 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table inet6.0 in instance default-domain:default-project:ip-fabric:__default__ : Register table completed for action 1 controller/src/bgp/bgp_membership.cc 652 2025-02-10 Mon 02:06:05:347.156 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table inet6.0 completed controller/src/bgp/bgp_xmpp_channel.cc 2270 2025-02-10 Mon 02:06:05:353.928 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer scheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2875 2025-02-10 Mon 02:06:05:375.721 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094153393920, Pid 1]: BGP [SYS_WARN]: XmppPeerInstanceLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in instance default-domain:default-project:ip-fabric:__default__ : Bad label -1 for inet route 10.0.0.0/24 controller/src/bgp/bgp_xmpp_channel.cc 1242 2025-02-10 Mon 02:06:05:381.556 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGP [SYS_WARN]: XmppPeerInstanceLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in instance default-domain:default-project:ip-fabric:__default__ : Bad label -1 for inet route 10.0.0.0/24 controller/src/bgp/bgp_xmpp_channel.cc 1242 2025-02-10 Mon 02:06:06:071.266 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:06:06:071.878 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:06:06:071.915 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:06:06:071.939 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:06:06:071.972 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: LinkOper: LinkAdd virtual-machine-interface:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 - virtual-router:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 , lhs: , rhs: 1 controller/src/ifmap/ifmap_graph_walker.cc 112 2025-02-10 Mon 02:06:06:077.373 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: virtual-machine-interface:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:06:077.422 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: virtual-network:default-domain:default-project:ip-fabric , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:06:077.445 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: project:default-domain:default-project , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:06:077.459 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: access-control-list:default-domain:default-project:ip-fabric:ip-fabric , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:06:077.475 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: routing-instance:default-domain:default-project:ip-fabric:ip-fabric , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:06:077.573 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of virtual-machine-interface:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.602 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.615 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of virtual-network:default-domain:default-project:ip-fabric to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.633 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.643 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of project:default-domain:default-project to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.684 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.708 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of access-control-list:default-domain:default-project:ip-fabric:ip-fabric to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.783 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.799 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of routing-instance:default-domain:default-project:ip-fabric:ip-fabric to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:077.825 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:078.021 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:06:06:078.042 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:06:06:078.072 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:06:06:078.087 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: BGPConfig [SYS_DEBUG]: BgpConfigInstanceUpdateLog: Routing Instance default-domain:default-project:ip-fabric:__default__ Import Targets import_rt= [ [ target:10.0.0.38:0, target:64512:7999999, ] ] Export Targets export_rt= [ [ ] ] Virtual Network default-domain:default-project:ip-fabric VN Index 2 controller/src/bgp/bgp_config_ifmap.cc 2184 2025-02-10 Mon 02:06:06:078.125 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: RoutingInstance [SYS_DEBUG]: RoutingInstanceUpdateLog: VirtualNetwork default-domain:default-project:ip-fabric Routing Instance default-domain:default-project:ip-fabric:ip-fabric Import Targets import_rt= [ [ target:10.0.0.38:1, target:64512:7999999, target:64512:8000003, ] ] Export Targets export_rt= [ [ target:64512:8000003, ] ] VN Index 2 controller/src/bgp/routing-instance/routing_instance.cc 633 2025-02-10 Mon 02:06:06:133.008 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 with id 1 controller/src/bgp/bgp_xmpp_channel.cc 2192 2025-02-10 Mon 02:06:06:133.067 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.evpn.0 with id 1 controller/src/bgp/bgp_xmpp_channel.cc 2192 2025-02-10 Mon 02:06:06:133.082 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.inet.0 with id 1 controller/src/bgp/bgp_xmpp_channel.cc 2192 2025-02-10 Mon 02:06:06:133.097 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.inet6.0 with id 1 controller/src/bgp/bgp_xmpp_channel.cc 2192 2025-02-10 Mon 02:06:06:133.108 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 with id 1 controller/src/bgp/bgp_xmpp_channel.cc 2192 2025-02-10 Mon 02:06:06:133.209 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table requested for action 1 controller/src/bgp/bgp_membership.cc 637 2025-02-10 Mon 02:06:06:133.247 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.evpn.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table requested for action 1 controller/src/bgp/bgp_membership.cc 637 2025-02-10 Mon 02:06:06:133.276 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.inet.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table requested for action 1 controller/src/bgp/bgp_membership.cc 637 2025-02-10 Mon 02:06:06:133.305 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.inet6.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table requested for action 1 controller/src/bgp/bgp_membership.cc 637 2025-02-10 Mon 02:06:06:133.341 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table requested for action 1 controller/src/bgp/bgp_membership.cc 637 2025-02-10 Mon 02:06:06:133.383 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table completed for action 1 controller/src/bgp/bgp_membership.cc 652 2025-02-10 Mon 02:06:06:133.402 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.ermvpn.0 completed controller/src/bgp/bgp_xmpp_channel.cc 2270 2025-02-10 Mon 02:06:06:133.422 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.evpn.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table completed for action 1 controller/src/bgp/bgp_membership.cc 652 2025-02-10 Mon 02:06:06:133.434 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.evpn.0 completed controller/src/bgp/bgp_xmpp_channel.cc 2270 2025-02-10 Mon 02:06:06:133.447 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.inet.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table completed for action 1 controller/src/bgp/bgp_membership.cc 652 2025-02-10 Mon 02:06:06:133.461 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.inet.0 completed controller/src/bgp/bgp_xmpp_channel.cc 2270 2025-02-10 Mon 02:06:06:133.474 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.inet6.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table completed for action 1 controller/src/bgp/bgp_membership.cc 652 2025-02-10 Mon 02:06:06:133.484 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.inet6.0 completed controller/src/bgp/bgp_xmpp_channel.cc 2270 2025-02-10 Mon 02:06:06:133.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerTableLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in table default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 in instance default-domain:default-project:ip-fabric:ip-fabric : Register table completed for action 1 controller/src/bgp/bgp_membership.cc 652 2025-02-10 Mon 02:06:06:133.507 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_DEBUG]: XmppPeerMembershipLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 Subscribe to table default-domain:default-project:ip-fabric:ip-fabric.mvpn.0 completed controller/src/bgp/bgp_xmpp_channel.cc 2270 2025-02-10 Mon 02:06:06:133.526 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094182782720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer scheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2875 2025-02-10 Mon 02:06:06:179.753 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094269617920, Pid 1]: BGP [SYS_WARN]: XmppPeerInstanceLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 in instance default-domain:default-project:ip-fabric:__default__ : Bad label -1 for inet route 10.0.0.0/24 controller/src/bgp/bgp_xmpp_channel.cc 1242 2025-02-10 Mon 02:06:06:269.191 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-10 Mon 02:06:06:269.413 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface-routing-instance:attr(default-domain:default-project:ip-fabric:ip-fabric,default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-10 Mon 02:06:06:270.609 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:06:06:270.635 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-routing-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-10 Mon 02:06:06:270.694 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: LinkOper: LinkAdd virtual-machine-interface:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 - virtual-machine-interface-routing-instance:attr(default-domain:default-project:ip-fabric:ip-fabric,default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0) , lhs: 1 , rhs: controller/src/ifmap/ifmap_graph_walker.cc 112 2025-02-10 Mon 02:06:06:270.726 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: JoinVertex: virtual-machine-interface-routing-instance:attr(default-domain:default-project:ip-fabric:ip-fabric,default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0) , current , adding 1 controller/src/ifmap/ifmap_graph_walker.cc 95 2025-02-10 Mon 02:06:06:270.778 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of virtual-machine-interface:default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0 to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:270.812 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of virtual-machine-interface-routing-instance:attr(default-domain:default-project:ip-fabric:ip-fabric,default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1:vhost0) to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:270.832 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:06:270.858 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: IFMap [SYS_DEBUG]: IFMapClientSendInfo: Sent Update of link to vRouter default-global-system-config:cn-jenkins-deploy-platform-juju-os-472-1 cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 controller/src/ifmap/ifmap_update_sender.cc 338 2025-02-10 Mon 02:06:07:134.740 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:08:135.045 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094178584320, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:09:135.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:10:135.374 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:11:135.675 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:12:135.828 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:13:136.307 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:14:138.202 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:15:138.387 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:16:138.544 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:17:138.735 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:18:138.952 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094161790720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:19:139.112 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:20:139.284 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:21:139.458 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094165989120, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:22:139.671 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094257022720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:23:139.866 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094170187520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:24:140.055 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094265419520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:25:140.566 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094149195520, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:26:141.007 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:27:141.186 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094136600320, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:28:141.361 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094140798720, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:29:141.555 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094144997120, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib Send timer rescheduled to fire after 1 second(s) controller/src/bgp/bgp_xmpp_channel.cc 2833 2025-02-10 Mon 02:06:30:141.778 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 SEND EndOfRib marker sent controller/src/bgp/bgp_xmpp_channel.cc 2906 2025-02-10 Mon 02:08:33:600.076 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:59904 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:08:33:645.526 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:59904 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:08:38:160.212 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:42856 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:08:38:205.496 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:42856 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:08:43:412.416 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:42872 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:08:43:457.772 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:42872 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:10:16:512.036 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:53924 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:10:16:557.504 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:53924 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:11:00:596.801 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: BGP [SYS_INFO]: XmppPeerMessageLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 RECV EndOfRib Receive timer expired controller/src/bgp/bgp_xmpp_channel.cc 2805 2025-02-10 Mon 02:11:00:596.855 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094273816320, Pid 1]: BGP [SYS_INFO]: XmppPeerEventLog: XMPP Peer cn-jenkins-deploy-platform-juju-os-472-1:10.0.0.38 PeerCloseManager: State NONE, MembershipState: NONE, MembershipReqPending: 0, CloseAgain?: No: Enqueued event EOR_RECEIVED, graceful 1, family unspecified controller/src/bgp/peer_close_manager.cc 144 2025-02-10 Mon 02:13:43:359.746 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:56690 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:13:43:401.454 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:56690 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:13:48:035.870 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:56870 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:13:48:085.538 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:56870 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:13:53:223.413 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:56886 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:13:53:265.438 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:56886 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:14:16:663.933 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:58790 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:14:16:705.462 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:58790 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:17:57:611.759 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46624 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:17:57:657.435 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46624 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:18:02:107.608 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46628 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:18:02:149.543 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46628 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:18:07:131.559 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:58514 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:18:07:173.482 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:58514 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:19:27:424.056 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:54540 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:19:27:469.804 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:54540 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:22:43:072.004 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46742 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:22:43:113.441 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46742 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:22:47:547.624 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:49082 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:22:47:589.524 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:49082 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:22:52:711.830 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:49098 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:22:52:757.497 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:49098 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:23:40:648.491 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:33688 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:23:40:693.461 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:33688 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:27:00:371.818 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36074 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:27:00:417.476 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36074 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:27:04:819.863 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36088 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:27:04:861.505 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36088 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:27:09:691.795 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:52494 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:27:09:737.422 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:52494 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:28:40:269.629 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:47930 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:28:40:313.784 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:47930 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:32:27:501.177 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:34524 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:32:27:545.519 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:34524 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:32:36:585.281 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:40544 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:32:36:633.432 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:40544 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:32:42:184.881 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:40554 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:32:42:233.768 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:40554 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:34:28:627.384 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:43920 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:34:28:673.576 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:43920 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:38:00:187.448 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46138 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:38:00:229.314 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46138 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:38:04:831.365 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46144 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:38:04:873.567 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:46144 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:38:09:735.937 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36146 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:38:09:781.433 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36146 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:39:39:823.495 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:55638 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:39:39:865.486 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:55638 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:43:03:695.431 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:47606 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:43:03:737.471 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:47606 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:43:08:071.466 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36170 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:43:08:113.425 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36170 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:43:13:183.917 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36186 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:43:13:225.764 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:36186 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:44:01:208.506 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:33860 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:44:01:253.731 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:33860 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2025-02-10 Mon 02:46:55:011.634 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:47326 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-10 Mon 02:46:55:061.534 UTC cn-jenkins-deploy-platform-juju-os-472-1 [Thread 140094431881344, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8083::10.0.0.38:47326 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504