2025-06-02 Mon 01:56:41:164.963 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819061204736, Pid 805]: KsyncTxQueue CPU pinning policy <>. KsyncTxQueuen not pinned to CPU
2025-06-02 Mon 01:56:41:284.483 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: No Client: 1748829401284368  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:41:285.299 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829401284661 AgentVrf [SYS_INFO]: VrfObjectLog: vrf= [ event = Addition  name = default-domain:default-project:ip-fabric:__default__ index = 0 ] file = controller/src/vnsw/agent/oper/vrf.cc line = 414
2025-06-02 Mon 01:56:41:285.348 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829401284685 AgentVrf [SYS_INFO]: VrfObjectLog: vrf= [ event = Addition  name = default-domain:default-project:ip-fabric:ip-fabric index = 1 ] file = controller/src/vnsw/agent/oper/vrf.cc line = 414
2025-06-02 Mon 01:56:41:285.386 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829401284697  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ],  ] ] ]
2025-06-02 Mon 01:56:41:285.485 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829401284758  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Disconnect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:41:285.563 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829401284790  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Disconnect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:41:285.590 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829401284802  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.49:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ],  ] ] ]
2025-06-02 Mon 01:56:41:285.643 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:41:285.764 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829401285268  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:41:285.787 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829401285615  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ],  ] ] ]
2025-06-02 Mon 01:56:41:285.900 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829401285706  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 2,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 6,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:41:296.410 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829401296343  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:41:296.489 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829401296392  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, Collector connection down, No Configuration for self Number of connections:2, Expected: 3 ],  ] ] ]
2025-06-02 Mon 01:56:41:296.532 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829401296513  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:41:296.558 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829401296530  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:41:343.653 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829401343622  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:41:344.082 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:41:344.139 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829401344123  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 36011 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:41:344.144 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:41:344.178 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829401344170  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:41:345.635 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829401345611  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:41:345.757 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:41:345.793 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829401345779  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 45021 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:41:345.804 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:41:345.829 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829401345821  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:42:286.381 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829402285765  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.49:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:42:286.477 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:42:286.670 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829402286328  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 9,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:42:286.704 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829402286461  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:42:286.817 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829402286544  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 10,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:42:298.263 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829402298232  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:42:298.499 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829402298482  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 40801 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:42:298.507 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:42:298.590 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:42:298.640 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829402298631  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:42:362.988 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829402362941  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:42:363.160 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:42:363.236 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:42:363.261 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829402363205  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 43937 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:42:363.290 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829402363259  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:44:287.183 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829404286633  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.49:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:44:287.257 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:44:287.472 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829404287155  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 14,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 29,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:44:287.523 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829404287240  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:44:287.640 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829404287325  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 15,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:44:343.426 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829404343387  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:44:343.696 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:44:343.775 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829404343733  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 37451 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:44:343.777 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:44:343.832 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829404343822  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:44:386.876 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829404386832  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:44:387.093 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:44:387.107 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829404387068  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 39273 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:44:387.201 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:44:387.258 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829404387243  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:47:987.495 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829407987343  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:47:987.930 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:47:987.939 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829407987883  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 37995 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:47:987.990 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:47:988.075 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829407988023  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:47:988.107 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829407988042  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:47:988.144 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829407988101  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:48:268.008 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829408267962  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:48:268.292 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:48:268.372 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:48:268.377 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829408268331  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 38727 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:48:268.440 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829408268398  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:48:268.467 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829408268402  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:48:268.501 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829408268450  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:48:287.659 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829408287402  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.49:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:48:287.732 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:48:287.909 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829408287630  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 25,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 49,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:48:287.947 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829408287713  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:48:288.053 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829408287801  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 26,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 50,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:55:476.224 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829415476167  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:55:476.374 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:55:476.511 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:55:476.583 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829415476354  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 39277 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:55:476.605 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829415476554  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:55:476.620 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829415476561  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:55:756.662 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829415756536  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:55:757.848 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:56:55:757.922 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829415757889  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 35587 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:55:758.040 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:55:758.110 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829415758060  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:55:758.124 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829415758071  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:56:56:292.004 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829416290660  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.49:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:56:292.063 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:56:56:292.238 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829416291973  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 33,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 61,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:56:56:292.269 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829416292046  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:56:56:292.376 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829416292128  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 34,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 62,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:57:10:302.269 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829430302161  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:10:302.982 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:57:10:303.029 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:57:10:303.107 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829430303008  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 34527 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:10:303.121 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829430303050  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:10:303.130 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829430303053  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:11:045.598 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829431045552  [SYS_NOTICE]: UveVrouterAgent: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local interface_list= [  [ ] ] error_intf_list= [  [ ] ] no_config_intf_list= [  [ (*_iter151) = 00000000-0000-0000-0000-000000000000,  ] ] vmi_count= [  active = 1 ] down_interface_count = 1 ]
2025-06-02 Mon 01:57:11:047.044 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: Send FAILED: 1748829431046896  [SYS_NOTICE]: UveVirtualNetworkAgentTrace: data= [ name = __UNKNOWN__ vrf_stats_list= [  [ [  name = __untitled__ diag_packet_count = 0 unknown_unicast_floods = 0 arp_packet_counts= [  from_vm_interface= [ stats= [ proxies = 0 stitches = 0 floods = 0 ] ] from_physical_interface= [  stats= [ proxies = 0 stitches = 0 floods = 0 ] ] ] offload_packet_counts= [  gro = 0 ] nh_packet_counts= [  discards = 0 resolves = 0 l3_receives = 0 l2_receives = 0 local_vm_l3_forwards = 0 local_vm_l2_forwards = 0 vrf_translates = 0 ecmp_forwards = 0 tunnel_nh_stats= [  udp_encaps = 0 mpls_over_udp_encaps = 0 mpls_over_gre_encaps = 0 vxlan_encaps = 0 ] comp_nh_stats= [  source_replication_forwards = 0 edge_replication_forwards = 0 local_vm_l3_forwards = 0 total_multicast_forwards = 0 ] ] ],  ] ] ]
2025-06-02 Mon 01:57:11:284.786 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: Send FAILED: 1748829431284631  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 71 dequeues = 71 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 87 dequeues = 87 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1748829416292099 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1748829431046976 ] max_sm_queue_count = 8 ]
2025-06-02 Mon 01:57:11:284.956 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: Send FAILED: 1748829431284717  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 28 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 42,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 71,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:57:11:287.868 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829431287740  [SYS_NOTICE]: UveVrouterAgent: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local xmpp_peer_list= [  [ [  ip = 10.0.0.49 status = 0 setup_time = 0 primary = 1 ],  ] ] self_ip_list= [  [ (*_iter146) = 10.0.0.49,  ] ] build_info = {"build-info":[{"build-version":"nightly","build-time":"2025-06-02 00:26:11.811431","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-9311-1.novalocal","build-id":"unknown","build-number":"unknown"}]} phy_if= [  [ [  name = eth0 mac_address = fa:16:3e:bf:ba:86 ],  ] ] vhost_if= [  name = vhost0 mac_address = fa:16:3e:bf:ba:86 ] log_file = /var/log/contrail/vrouter-agent/contrail-vrouter-agent.log config_file = /etc/contrail/contrail-vrouter-agent.conf log_local = 1 log_level = SYS_NOTICE log_category =  sandesh_http_port = 8085 dns_servers= [  [ (*_iter149) = 10.0.0.49,  ] ] vhost_cfg= [  name = vhost0 ip = 10.0.0.49 ip_prefix_len = 24 gateway = 10.0.0.1 ] eth_name= [  [ (*_iter150) = eth0,  ] ] tunnel_type = MPLSoGRE hypervisor = kvm control_ip = 10.0.0.49 dns_server_list_cfg= [  [ (*_iter152) = 10.0.0.49:53,  ] ] control_node_list_cfg= [  [ (*_iter153) = 10.0.0.49:5269,  ] ] hostname_cfg = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local flow_cache_timeout_cfg = 0 ll_max_system_flows_cfg = 16384 ll_max_vm_flows_cfg = 16384 max_vm_flows_cfg = 100 gateway_cfg_list= [  [ ] ] headless_mode_cfg = 1 collector_server_list_cfg= [  [ (*_iter155) = 10.0.0.49:8086,  ] ] log_flow = 0 mode = VROUTER platform = HOST vr_limits= [  max_labels = 5120 max_nexthops = 524288 max_interfaces = 4355 max_vrfs = 4096 max_mirror_entries = 255 vrouter_max_bridge_entries = 262144 vrouter_max_oflow_bridge_entries = 53248 vrouter_build_info = {"build-info": [{"build-version": "nightly", "build-time": "2025-06-02 00:23:36.867629", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-9311-1.novalocal"}]} vrouter_max_flow_entries = 524288 vrouter_max_oflow_entries = 105472 vrouter_priority_tagging = 1 ] bgpaas_enabled = 0 port_mirror_enabled = 0 subcluster_name =  vr_high_watermark = 80 vr_low_watermark = 75 vr_limit_exceeded_list= [  [ ] ] res_limit = 0 res_table_limit = 0 loopback_ip = 0.0.0.0 gateway_list= [  [ (*_iter161) = 10.0.0.1,  ] ] ]
2025-06-02 Mon 01:57:11:288.037 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829431287792  [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local in_tpkts = 14149 in_bytes = 971401 out_tpkts = 58615 out_bytes = 604122578 exception_packets = 102 exception_packets_dropped = 9 exception_packets_allowed = 93 total_flows = 0 aged_flows = 0 uptime = 1748829401044891 phy_if_info= [  [ _iter254->first = eth0 [  speed = -1 duplexity = 255 ],  ] ] raw_vhost_stats= [  name = vhost0 in_pkts = 14149 in_bytes = 971401 out_pkts = 58615 out_bytes = 604122578 speed = -1 duplexity = -1 ] raw_vhost_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 9 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 10 ] raw_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 9 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 10 ] flow_rate= [  added_flows = 0 max_flow_adds_per_second = 0 min_flow_adds_per_second = 0 deleted_flows = 0 max_flow_deletes_per_second = 0 min_flow_deletes_per_second = 0 active_flows = 0 hold_flows = 0 ] raw_phy_if_stats= [  [ _iter262->first = eth0 [  in_pkts = 58517 in_bytes = 604118462 out_pkts = 14149 out_bytes = 971377 ],  ] ] raw_phy_if_drop_stats= [  [ _iter263->first = eth0 [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 9 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 9 ],  ] ] ]
2025-06-02 Mon 01:57:11:288.090 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829431288064  [SYS_NOTICE]: VrouterControlStatsTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local raw_xmpp_stats= [  [ _iter306->first = 10.0.0.49 [  reconnects = 0 in_msgs = 0 out_msgs = 0 ],  ] ] raw_ifmap_stats= [  [ _iter307->first = link_delete_parse_errors _iter307->second = 0,  _iter307->first = link_update_parse_errors _iter307->second = 0,  _iter307->first = node_delete_parse_errors _iter307->second = 0,  _iter307->first = node_update_parse_errors _iter307->second = 0,  ] ] raw_rt_table_size= [  [ _iter308->first = default-domain:default-project:ip-fabric:__default__ [  inet4_unicast = 6 inet4_multicast = 0 evpn = 0 bridge = 4 inet6_unicast = 2 ],  _iter308->first = default-domain:default-project:ip-fabric:ip-fabric [  inet4_unicast = 2 inet4_multicast = 0 evpn = 1 bridge = 2 inet6_unicast = 0 ],  ] ] ]
2025-06-02 Mon 01:57:11:316.728 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829431316646  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:11:317.143 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:57:11:317.202 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829431317165  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 38673 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:11:317.413 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:57:11:317.500 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829431317455  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:11:317.535 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829431317464  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:12:292.769 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829432292197  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.49:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:57:12:292.831 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:57:12:293.391 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829432292736  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 30 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 45,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 80,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:57:12:293.422 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829432292814  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:57:12:293.585 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829432292887  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 31 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 46,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 81,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:57:41:284.965 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: Send FAILED: 1748829461284796  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 84 dequeues = 84 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 103 dequeues = 103 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1748829432292855 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1748829432293459 ] max_sm_queue_count = 8 ]
2025-06-02 Mon 01:57:41:285.145 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: Send FAILED: 1748829461284888  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 42 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 57,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 84,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:57:41:288.323 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829461288210  [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local cpu_info= [  num_cpu = 4 sys_mem_info= [  total = 25603328 used = 0 free = 834510382 buffers = 32554 cached = 25467008 node_type =  ] meminfo= [  virt = 32554 peakvirt = 820476312 res = 32554 ] cpuload= [  one_min_avg = 6.9325 five_min_avg = 2.2825 fifteen_min_avg = 0.8175 ] cpu_share = 0.860778 ] ]
2025-06-02 Mon 01:57:41:288.359 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829461288240  [SYS_NOTICE]: ComputeCpuStateTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local cpu_info= [  [ [  mem_virt = 32554 cpu_share = 0.860778 used_sys_mem = 4269467734 one_min_cpuload = 6.9325 mem_res = 32554 ],  ] ] ]
2025-06-02 Mon 01:57:41:288.527 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829461288265  [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local in_tpkts = 19899 in_bytes = 1401730 out_tpkts = 82284 out_bytes = 868943014 exception_packets = 121 exception_packets_allowed = 112 raw_vhost_stats= [  name = vhost0 in_pkts = 19899 in_bytes = 1401730 out_pkts = 82284 out_bytes = 868943014 speed = -1 duplexity = -1 ] raw_vhost_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 31 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 32 ] raw_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 31 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 32 ] flow_rate= [  added_flows = 0 max_flow_adds_per_second = 0 min_flow_adds_per_second = 0 deleted_flows = 0 max_flow_deletes_per_second = 0 min_flow_deletes_per_second = 0 active_flows = 0 hold_flows = 0 ] raw_phy_if_stats= [  [ _iter262->first = eth0 [  in_pkts = 82153 in_bytes = 868937512 out_pkts = 19900 out_bytes = 1401748 ],  ] ] raw_phy_if_drop_stats= [  [ _iter263->first = eth0 [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 31 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 31 ],  ] ] ]
2025-06-02 Mon 01:57:41:288.566 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829461288288  [SYS_NOTICE]: VrouterControlStatsTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local raw_xmpp_stats= [  [ _iter306->first = 10.0.0.49 [  reconnects = 0 in_msgs = 0 out_msgs = 0 ],  ] ] raw_ifmap_stats= [  [ _iter307->first = link_delete_parse_errors _iter307->second = 0,  _iter307->first = link_update_parse_errors _iter307->second = 0,  _iter307->first = node_delete_parse_errors _iter307->second = 0,  _iter307->first = node_update_parse_errors _iter307->second = 0,  ] ] raw_rt_table_size= [  [ _iter308->first = default-domain:default-project:ip-fabric:__default__ [  inet4_unicast = 7 inet4_multicast = 0 evpn = 0 bridge = 5 inet6_unicast = 2 ],  _iter308->first = default-domain:default-project:ip-fabric:ip-fabric [  inet4_unicast = 2 inet4_multicast = 0 evpn = 1 bridge = 2 inet6_unicast = 0 ],  ] ] ]
2025-06-02 Mon 01:57:41:893.495 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829461893369  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:41:896.387 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:10.0.0.49 RECV  Mode Client:  Event: Tcp Connected  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295
2025-06-02 Mon 01:57:41:896.562 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829461896488  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 38819 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:41:897.024 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829461897003  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 38819 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:41:901.341 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:10.0.0.49 RECV  Mode Client:  Event: Tcp Connection Closed  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1310
2025-06-02 Mon 01:57:41:901.363 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829461901329  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = OpenSent next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:41:901.426 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829461901388  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Established next_state = Active event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:41:901.464 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829461901395  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:41:901.489 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829461901408  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Up description = OpenSent ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:57:41:901.511 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: SANDESH: Send FAILED: 1748829461901485  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Established ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:57:42:294.158 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829462292965  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Established ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.49:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:57:42:294.222 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:57:42:294.472 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829462294127  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 44 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 50 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 61,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 98,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:57:42:294.507 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829462294204  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Established ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, XMPP:dns-server:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:57:42:294.664 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819082196736, Pid 805]: SANDESH: Send FAILED: 1748829462294276  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 45 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 50 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 62,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 99,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:57:42:907.657 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829462907560  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:42:908.345 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.49 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2025-06-02 Mon 01:57:42:908.405 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-06-02 Mon 01:57:42:908.461 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829462908379  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 41493 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:42:909.350 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: Send FAILED: 1748829462909293  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:57:42:909.372 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: Send FAILED: 1748829462909300  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:58:10:179.699 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: SANDESH: Send FAILED: 1748829490179603  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:58:10:182.311 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:10.0.0.49 RECV  Mode Client:  Event: Tcp Connected  peer ip: 10.0.0.49 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295
2025-06-02 Mon 01:58:10:182.464 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829490182357  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect event = Connect Event local_port = 34271 remote_port = 8093 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:58:10:182.485 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829490182445  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 34271 remote_port = 8093 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:58:10:244.129 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829490244078  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.49 state = OpenSent next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2025-06-02 Mon 01:58:10:244.214 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: SANDESH: Send FAILED: 1748829490244186  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Established ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Up description = OpenSent ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:58:11:287.668 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: Send FAILED: 1748829491287502  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 111 dequeues = 111 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 133 dequeues = 133 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1748829462294245 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1748829490244197 ] max_sm_queue_count = 8 ]
2025-06-02 Mon 01:58:11:287.856 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819073799936, Pid 805]: SANDESH: Send FAILED: 1748829491287600  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 57 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 58 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 76,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 111,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:58:11:288.384 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829491288331  [SYS_NOTICE]: UveVrouterAgent: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local xmpp_peer_list= [  [ [  ip = 10.0.0.49 status = 0 setup_time = 1748829461901412 primary = 0 ],  ] ] ]
2025-06-02 Mon 01:58:11:288.535 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829491288363  [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local in_tpkts = 34702 in_bytes = 2423088 out_tpkts = 115024 out_bytes = 1038465674 exception_packets = 123 exception_packets_dropped = 10 exception_packets_allowed = 113 raw_vhost_stats= [  name = vhost0 in_pkts = 34702 in_bytes = 2423088 out_pkts = 115024 out_bytes = 1038465674 speed = -1 duplexity = -1 ] raw_vhost_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 31 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 32 ] raw_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 31 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 1 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 32 ] total_in_bandwidth_utilization = 3.13942e-10 total_out_bandwidth_utilization = 1.04931e-12 flow_rate= [  added_flows = 0 max_flow_adds_per_second = 0 min_flow_adds_per_second = 0 deleted_flows = 0 max_flow_deletes_per_second = 0 min_flow_deletes_per_second = 0 active_flows = 0 hold_flows = 0 ] phy_band_in_bps= [  [ _iter260->first = eth0 _iter260->second = 57912144,  ] ] phy_band_out_bps= [  [ _iter261->first = eth0 _iter261->second = 193563,  ] ] raw_phy_if_stats= [  [ _iter262->first = eth0 [  in_pkts = 114878 in_bytes = 1038459542 out_pkts = 34703 out_bytes = 2423106 ],  ] ] raw_phy_if_drop_stats= [  [ _iter263->first = eth0 [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 31 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 31 ],  ] ] ]
2025-06-02 Mon 01:58:11:288.590 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819052807936, Pid 805]: SANDESH: Send FAILED: 1748829491288563  [SYS_NOTICE]: VrouterControlStatsTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local raw_xmpp_stats= [  [ _iter306->first = 10.0.0.49 [  reconnects = 1 in_msgs = 0 out_msgs = 1 ],  ] ] raw_ifmap_stats= [  [ _iter307->first = link_delete_parse_errors _iter307->second = 0,  _iter307->first = link_update_parse_errors _iter307->second = 0,  _iter307->first = node_delete_parse_errors _iter307->second = 0,  _iter307->first = node_update_parse_errors _iter307->second = 0,  ] ] raw_rt_table_size= [  [ _iter308->first = default-domain:default-project:ip-fabric:__default__ [  inet4_unicast = 7 inet4_multicast = 0 evpn = 0 bridge = 5 inet6_unicast = 2 ],  _iter308->first = default-domain:default-project:ip-fabric:ip-fabric [  inet4_unicast = 2 inet4_multicast = 0 evpn = 1 bridge = 2 inet6_unicast = 0 ],  ] ] ]
2025-06-02 Mon 01:58:12:299.576 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829492296544  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Established ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Up description = OpenSent ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.49:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:58:12:300.625 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829492299539  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 58 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 58 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 77,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 116,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:58:12:300.664 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829492300385  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:5269,  ] ] status = Down description = Established ],  [  type = XMPP name = dns-server:10.0.0.49 server_addrs= [  [ (*_iter6) = 10.0.0.49:53,  ] ] status = Up description = OpenSent ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.49:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.49, Collector connection down, No Configuration for self ],  ] ] ]
2025-06-02 Mon 01:58:12:300.814 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: SANDESH: Send FAILED: 1748829492300463  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = ClientInit successful_connections = 1 pid = 805 http_port = 8085 start_time = 1748829401284284 collector_name =  collector_ip = 10.0.0.49:8086 collector_list= [  [ (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 58 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 58 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 77,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 117,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-06-02 Mon 01:58:14:034.310 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:10.0.0.49 RECV  Mode Client:  Event: Tcp Connected  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295
2025-06-02 Mon 01:58:14:039.515 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:10.0.0.49 RECV  Mode Client:  Event: Tcp Connection Closed  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1310
2025-06-02 Mon 01:58:45:902.220 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819231308096, Pid 805]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-198-1.cluster.local:10.0.0.49 RECV  Mode Client:  Event: Tcp Connected  peer ip: 10.0.0.49 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295
2025-06-02 Mon 02:01:46:338.753 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-87e6db> Agent-index <8>
2025-06-02 Mon 02:01:52:835.147 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: ID-PERM not set for object <default-domain:k8s-default:dce32f34-6770-4bb3-939f-155d1e072dc4> Table <__ifmap__.service_instance.0>. Ignoring it
2025-06-02 Mon 02:01:53:108.334 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-ed322a> Agent-index <5>
2025-06-02 Mon 02:01:53:114.024 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819057006336, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-ed322a> Agent-index <5>
2025-06-02 Mon 02:01:58:133.567 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-2b51bf> Agent-index <6>
2025-06-02 Mon 02:01:58:141.245 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-2b51bf> Agent-index <6>
2025-06-02 Mon 02:01:58:155.472 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819069601536, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-2b51bf> Agent-index <6>
2025-06-02 Mon 02:05:47:111.934 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-0542f1> Agent-index <5>
2025-06-02 Mon 02:05:47:155.311 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-8bb6db> Agent-index <10>
2025-06-02 Mon 02:05:47:191.386 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819077998336, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-99070c> Agent-index <7>
2025-06-02 Mon 02:06:17:026.506 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-5bc869> Agent-index <12>
2025-06-02 Mon 02:06:17:029.038 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-80a3eb> Agent-index <11>
2025-06-02 Mon 02:06:17:033.215 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-80a3eb> Agent-index <11>
2025-06-02 Mon 02:06:17:035.997 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-80a3eb> Agent-index <11>
2025-06-02 Mon 02:06:17:109.119 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-5ad873> Agent-index <9>
2025-06-02 Mon 02:06:17:117.370 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-efc9db> Agent-index <8>
2025-06-02 Mon 02:06:17:120.351 UTC  cn-jenkins-deploy-platform-k8s-manifests-198-1 [Thread 139819065403136, Pid 805]: Error <19: No such device> querying mac-address for interface <tapeth0-efc9db> Agent-index <8>